[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:54:56 dist-test-slave-tfpf krb5kdc[11020](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:54:56 dist-test-slave-tfpf krb5kdc[11020](info): set up 2 sockets
Aug 07 06:54:56 dist-test-slave-tfpf krb5kdc[11020](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 06:54:57.355731 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.006s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:54:57 dist-test-slave-tfpf krb5kdc[11020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:54:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:54:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:54:57.570529 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42209
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:45559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:42209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:54:57.918316 11037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:54:57.918633 11037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:54:57.918737 11037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:54:57.925757 11037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:54:57.925896 11037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:54:57.925938 11037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:54:57.925999 11037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:54:57.926043 11037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:54:57.935624 11037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:45559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:42209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:54:57.937019 11037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:54:57.938381 11037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:54:57.950443 11047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:54:57.950470 11044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:54:57.950512 11042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:54:57.951596 11037 server_base.cc:1034] running on GCE node
I20260807 06:54:57.952441 11037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:54:57.954001 11037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:54:57.955235 11037 hybrid_clock.cc:648] HybridClock initialized: now 1786085697955198 us; error 68 us; skew 500 ppm
I20260807 06:54:57.955561 11037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:54:57 dist-test-slave-tfpf krb5kdc[11020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085697, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:54:57.963464 11037 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:54:57.965157 11037 webserver.cc:460] Webserver started at http://127.10.191.190:42099/ using document root <none> and password file <none>
I20260807 06:54:57.965992 11037 fs_manager.cc:359] Metadata directory not provided
I20260807 06:54:57.966130 11037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:54:57.966485 11037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:54:57.969861 11037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "8db19396b5e242ea84e82ab9653f9186"
format_stamp: "Formatted at 2026-08-07 06:54:57 on dist-test-slave-tfpf"
server_key: "7112cb6a5728d3d6efe9ecea827426ef"
server_key_iv: "8d2d34cc2c58cc54cfe5ecc3a7302378"
server_key_version: "encryptionkey@0"
I20260807 06:54:57.970659 11037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "8db19396b5e242ea84e82ab9653f9186"
format_stamp: "Formatted at 2026-08-07 06:54:57 on dist-test-slave-tfpf"
server_key: "7112cb6a5728d3d6efe9ecea827426ef"
server_key_iv: "8d2d34cc2c58cc54cfe5ecc3a7302378"
server_key_version: "encryptionkey@0"
I20260807 06:54:57.976310 11037 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 06:54:57.980317 11060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:57.981976 11037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:54:57.982195 11037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "8db19396b5e242ea84e82ab9653f9186"
format_stamp: "Formatted at 2026-08-07 06:54:57 on dist-test-slave-tfpf"
server_key: "7112cb6a5728d3d6efe9ecea827426ef"
server_key_iv: "8d2d34cc2c58cc54cfe5ecc3a7302378"
server_key_version: "encryptionkey@0"
I20260807 06:54:57.982430 11037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:54:58.009542 11037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:54:58.013871 11037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:54:58.014209 11037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:54:58.033568 11037 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:42209
I20260807 06:54:58.033588 11142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:42209 every 8 connection(s)
I20260807 06:54:58.035023 11037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:54:58.038951 11143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:54:58.042740 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11037
I20260807 06:54:58.043058 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:54:58.045670 11006 external_mini_cluster.cc:1428] Setting key 5b38e1407d02f9fcc5c3c6c0a85e0cc5
I20260807 06:54:58.053169 11143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186: Bootstrap starting.
I20260807 06:54:58.056279 11143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186: Neither blocks nor log segments found. Creating new log.
I20260807 06:54:58.057464 11143 log.cc:824] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186: Log is configured to *not* fsync() on all Append() calls
I20260807 06:54:58.060428 11143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186: No bootstrap required, opened a new log
I20260807 06:54:58.068287 11143 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db19396b5e242ea84e82ab9653f9186" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42209 } }
I20260807 06:54:58.068687 11143 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:54:58.068794 11143 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8db19396b5e242ea84e82ab9653f9186, State: Initialized, Role: FOLLOWER
I20260807 06:54:58.069461 11143 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db19396b5e242ea84e82ab9653f9186" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42209 } }
I20260807 06:54:58.069738 11143 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:54:58.069888 11143 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:54:58.070083 11143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:54:58.072528 11143 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db19396b5e242ea84e82ab9653f9186" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42209 } }
I20260807 06:54:58.073103 11143 leader_election.cc:302] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8db19396b5e242ea84e82ab9653f9186; no voters:
I20260807 06:54:58.073815 11143 leader_election.cc:288] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:54:58.073939 11150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:54:58.075344 11150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [term 1 LEADER]: Becoming Leader. State: Replica: 8db19396b5e242ea84e82ab9653f9186, State: Running, Role: LEADER
Aug 07 06:54:58 dist-test-slave-tfpf krb5kdc[11020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:54:58.075950 11150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db19396b5e242ea84e82ab9653f9186" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42209 } }
I20260807 06:54:58.076390 11143 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:54:58.079342 11152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8db19396b5e242ea84e82ab9653f9186" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db19396b5e242ea84e82ab9653f9186" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42209 } } }
I20260807 06:54:58.079871 11152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [sys.catalog]: This master's current role is: LEADER
I20260807 06:54:58.080468 11153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8db19396b5e242ea84e82ab9653f9186. Latest consensus state: current_term: 1 leader_uuid: "8db19396b5e242ea84e82ab9653f9186" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db19396b5e242ea84e82ab9653f9186" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42209 } } }
I20260807 06:54:58.080765 11153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186 [sys.catalog]: This master's current role is: LEADER
I20260807 06:54:58.081594 11158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:54:58.086706 11158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:54:58.093973 11148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:58.050857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37148 (local address 127.10.191.190:42209)
0807 06:54:58.053235 (+ 2378us) server_negotiation.cc:206] Beginning negotiation
0807 06:54:58.053251 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:54:58.053306 (+ 55us) server_negotiation.cc:407] Connection header received
0807 06:54:58.062266 (+ 8960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:54:58.062289 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:54:58.062700 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:54:58.063118 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:54:58.066184 (+ 3066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:58.067550 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:58.069553 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:58.070453 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:58.070678 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:58.077434 (+ 6756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:54:58.077442 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:54:58.077456 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:54:58.077519 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:54:58.084121 (+ 6602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:58.085610 (+ 1489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:58.085624 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:58.085633 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:58.085875 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:58.086807 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:58.086814 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:58.086819 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:58.087713 (+ 894us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:54:58.091198 (+ 3485us) server_negotiation.cc:1035] Waiting for connection context
0807 06:54:58.091541 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 06:54:58.092136 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2034,"thread_start_us":1792,"threads_started":1}
I20260807 06:54:58.100307 11158 catalog_manager.cc:1347] Generated new cluster ID: 94dfc6f92af645bb965556e8f4f85998
I20260807 06:54:58.100435 11158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:54:58.114908 11158 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:54:58.116232 11158 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:54:58.122334 11158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8db19396b5e242ea84e82ab9653f9186: Generated new TSK 0
I20260807 06:54:58.123198 11158 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:54:58.181138 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42209
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:45559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:54:58.538266 11184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:54:58.538570 11184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:54:58.538753 11184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:54:58.546060 11184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:54:58.546187 11184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:54:58.546372 11184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:54:58.556342 11184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:45559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42209
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:54:58.557847 11184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:54:58.559343 11184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:54:58.572858 11190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:54:58.573606 11192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:54:58.574299 11194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:54:58.575358 11184 server_base.cc:1034] running on GCE node
I20260807 06:54:58.575997 11184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:54:58.577122 11184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:54:58.578356 11184 hybrid_clock.cc:648] HybridClock initialized: now 1786085698578290 us; error 58 us; skew 500 ppm
I20260807 06:54:58.578699 11184 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:54:58 dist-test-slave-tfpf krb5kdc[11020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085698, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:54:58.582094 11184 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:54:58.583572 11184 webserver.cc:460] Webserver started at http://127.10.191.129:39803/ using document root <none> and password file <none>
I20260807 06:54:58.584327 11184 fs_manager.cc:359] Metadata directory not provided
I20260807 06:54:58.584434 11184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:54:58.584733 11184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:54:58.587949 11184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "473852f81b81486e81348ac9f1642962"
format_stamp: "Formatted at 2026-08-07 06:54:58 on dist-test-slave-tfpf"
server_key: "534467c03bc986c6b805f956333f9c77"
server_key_iv: "0ab5cb71df0c762ad7891e2ec96c3840"
server_key_version: "encryptionkey@0"
I20260807 06:54:58.588900 11184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "473852f81b81486e81348ac9f1642962"
format_stamp: "Formatted at 2026-08-07 06:54:58 on dist-test-slave-tfpf"
server_key: "534467c03bc986c6b805f956333f9c77"
server_key_iv: "0ab5cb71df0c762ad7891e2ec96c3840"
server_key_version: "encryptionkey@0"
I20260807 06:54:58.594573 11184 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 06:54:58.598587 11203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:58.600052 11184 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:54:58.600255 11184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "473852f81b81486e81348ac9f1642962"
format_stamp: "Formatted at 2026-08-07 06:54:58 on dist-test-slave-tfpf"
server_key: "534467c03bc986c6b805f956333f9c77"
server_key_iv: "0ab5cb71df0c762ad7891e2ec96c3840"
server_key_version: "encryptionkey@0"
I20260807 06:54:58.600509 11184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:54:58.614743 11184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:54:58.619625 11184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:54:58.619880 11184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:54:58.620820 11184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:54:58.622313 11184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:54:58.622388 11184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:58.622546 11184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:54:58.622608 11184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:58.654907 11184 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:34247
I20260807 06:54:58.654947 11372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:34247 every 8 connection(s)
I20260807 06:54:58.656327 11184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:54:58.665931 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11184
I20260807 06:54:58.666200 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:54:58.667057 11006 external_mini_cluster.cc:1428] Setting key 796e4dea11e3acec922fd37c1915b65d
Aug 07 06:54:58 dist-test-slave-tfpf krb5kdc[11020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085698, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:54:58.678473 11381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:58.659112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:41497 (local address 127.10.191.190:42209)
0807 06:54:58.659552 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0807 06:54:58.659557 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:54:58.660642 (+ 1085us) server_negotiation.cc:407] Connection header received
0807 06:54:58.662640 (+ 1998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:54:58.662646 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:54:58.662751 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:54:58.662873 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:54:58.664407 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:58.665204 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:58.667704 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:58.668241 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:58.668381 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:58.672462 (+ 4081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:54:58.672467 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:54:58.672470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:54:58.672504 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:54:58.675130 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:58.675897 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:58.675904 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:58.675907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:58.676041 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:58.676494 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:58.676499 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:58.676503 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:58.676888 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:54:58.677046 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 06:54:58.677837 (+ 791us) server_negotiation.cc:299] Negotiation successful
0807 06:54:58.678086 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":213,"threads_started":1}
I20260807 06:54:58.679512 11382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:58.659663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42209 (local address 127.10.191.129:41497)
0807 06:54:58.660443 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0807 06:54:58.660482 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:54:58.662365 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:54:58.663113 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:54:58.663121 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:54:58.663642 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:54:58.664223 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:54:58.664242 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:54:58.665377 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:54:58.665382 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:54:58.667544 (+ 2162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:54:58.667561 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:54:58.668519 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:54:58.668527 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:54:58.668849 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:58.669700 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:54:58.669724 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:54:58.672224 (+ 2500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:54:58.675281 (+ 3057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:54:58.675291 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:54:58.675309 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:54:58.675772 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:54:58.676157 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:54:58.676162 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:54:58.676166 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:54:58.676378 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:54:58.677026 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:54:58.677034 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:54:58.677422 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 06:54:58.677723 (+ 301us) client_negotiation.cc:240] Negotiation successful
0807 06:54:58.678336 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":316,"threads_started":1}
I20260807 06:54:58.681277 11374 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42209
I20260807 06:54:58.681680 11374 heartbeater.cc:464] Registering TS with master...
I20260807 06:54:58.682753 11374 heartbeater.cc:511] Master 127.10.191.190:42209 requested a full tablet report, sending...
I20260807 06:54:58.685555 11088 ts_manager.cc:194] Registered new tserver with Master: 473852f81b81486e81348ac9f1642962 (127.10.191.129:34247)
I20260807 06:54:58.688045 11088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:41497
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:54:58.722517 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42209
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:45559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:54:59.071653 11385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:54:59.072032 11385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:54:59.072224 11385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:54:59.079378 11385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:54:59.079538 11385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:54:59.079705 11385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:54:59.089656 11385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:45559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42209
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:54:59.091089 11385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:54:59.092588 11385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:54:59.106089 11392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:54:59.106172 11393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:54:59.106135 11397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:54:59.106982 11385 server_base.cc:1034] running on GCE node
I20260807 06:54:59.107712 11385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:54:59.108764 11385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:54:59.109984 11385 hybrid_clock.cc:648] HybridClock initialized: now 1786085699109939 us; error 52 us; skew 500 ppm
I20260807 06:54:59.110311 11385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:54:59 dist-test-slave-tfpf krb5kdc[11020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:54:59.113476 11385 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:54:59.115075 11385 webserver.cc:460] Webserver started at http://127.10.191.130:37951/ using document root <none> and password file <none>
I20260807 06:54:59.115767 11385 fs_manager.cc:359] Metadata directory not provided
I20260807 06:54:59.115908 11385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:54:59.116233 11385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:54:59.119320 11385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "db372e669b6b4b7c91f86e1af045e121"
format_stamp: "Formatted at 2026-08-07 06:54:59 on dist-test-slave-tfpf"
server_key: "5f8e2b6a99be42274cefc8c9d10b12ed"
server_key_iv: "510085fc34c05983bc92092b50f08050"
server_key_version: "encryptionkey@0"
I20260807 06:54:59.120110 11385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "db372e669b6b4b7c91f86e1af045e121"
format_stamp: "Formatted at 2026-08-07 06:54:59 on dist-test-slave-tfpf"
server_key: "5f8e2b6a99be42274cefc8c9d10b12ed"
server_key_iv: "510085fc34c05983bc92092b50f08050"
server_key_version: "encryptionkey@0"
I20260807 06:54:59.125406 11385 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 06:54:59.128898 11404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:59.130286 11385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:54:59.130465 11385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "db372e669b6b4b7c91f86e1af045e121"
format_stamp: "Formatted at 2026-08-07 06:54:59 on dist-test-slave-tfpf"
server_key: "5f8e2b6a99be42274cefc8c9d10b12ed"
server_key_iv: "510085fc34c05983bc92092b50f08050"
server_key_version: "encryptionkey@0"
I20260807 06:54:59.130674 11385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:54:59.153954 11385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:54:59.157922 11385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:54:59.158252 11385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:54:59.159307 11385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:54:59.160650 11385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:54:59.160751 11385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:59.160897 11385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:54:59.160965 11385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:59.194844 11385 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:44621
I20260807 06:54:59.194933 11562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:44621 every 8 connection(s)
I20260807 06:54:59.196228 11385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:54:59.204766 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11385
I20260807 06:54:59.205019 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:54:59.205500 11006 external_mini_cluster.cc:1428] Setting key 75a40140b394680d66c5e2e3fb2138c7
Aug 07 06:54:59 dist-test-slave-tfpf krb5kdc[11020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:54:59.217813 11566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:59.198932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:34441 (local address 127.10.191.190:42209)
0807 06:54:59.199398 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0807 06:54:59.199403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:54:59.200251 (+ 848us) server_negotiation.cc:407] Connection header received
0807 06:54:59.202068 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:54:59.202074 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:54:59.202166 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:54:59.202276 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:54:59.203874 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.204664 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.206543 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.207191 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.207355 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:59.211310 (+ 3955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:54:59.211315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:54:59.211318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:54:59.211353 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:54:59.214260 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.215178 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.215183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.215185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.215316 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.215760 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.215765 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.215767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.216063 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:54:59.216243 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 06:54:59.217282 (+ 1039us) server_negotiation.cc:299] Negotiation successful
0807 06:54:59.217510 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":252,"threads_started":1}
I20260807 06:54:59.219647 11567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:59.199363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42209 (local address 127.10.191.130:34441)
0807 06:54:59.200087 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0807 06:54:59.200135 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:54:59.201805 (+ 1670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:54:59.202525 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:54:59.202532 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:54:59.203098 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:54:59.203682 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:54:59.203700 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.204803 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.204813 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:54:59.206379 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:54:59.206397 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.207430 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.207439 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:54:59.207702 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:59.208518 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:54:59.208554 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:54:59.211031 (+ 2477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:54:59.214408 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:54:59.214418 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:54:59.214437 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:54:59.215033 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:54:59.215429 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:54:59.215434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:54:59.215438 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:54:59.215638 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:54:59.216221 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:54:59.216230 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:54:59.216716 (+ 486us) client_negotiation.cc:769] Sending connection context
0807 06:54:59.217113 (+ 397us) client_negotiation.cc:240] Negotiation successful
0807 06:54:59.218551 (+ 1438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":280,"threads_started":1}
I20260807 06:54:59.221230 11563 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42209
I20260807 06:54:59.221603 11563 heartbeater.cc:464] Registering TS with master...
I20260807 06:54:59.222512 11563 heartbeater.cc:511] Master 127.10.191.190:42209 requested a full tablet report, sending...
I20260807 06:54:59.224213 11088 ts_manager.cc:194] Registered new tserver with Master: db372e669b6b4b7c91f86e1af045e121 (127.10.191.130:44621)
I20260807 06:54:59.225036 11088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:34441
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:54:59.255966 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42209
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:45559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:54:59.611891 11570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:54:59.612246 11570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:54:59.612419 11570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:54:59.620126 11570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:54:59.620285 11570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:54:59.620468 11570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:54:59.630666 11570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:45559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42209
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:54:59.632026 11570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:54:59.633432 11570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:54:59.647243 11578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:54:59.647188 11584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:54:59.647188 11579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:54:59.648093 11570 server_base.cc:1034] running on GCE node
I20260807 06:54:59.648763 11570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:54:59.649819 11570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:54:59.651058 11570 hybrid_clock.cc:648] HybridClock initialized: now 1786085699651005 us; error 66 us; skew 500 ppm
I20260807 06:54:59.651381 11570 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:54:59 dist-test-slave-tfpf krb5kdc[11020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:54:59.654757 11570 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:54:59.656309 11570 webserver.cc:460] Webserver started at http://127.10.191.131:44641/ using document root <none> and password file <none>
I20260807 06:54:59.657027 11570 fs_manager.cc:359] Metadata directory not provided
I20260807 06:54:59.657222 11570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:54:59.657620 11570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:54:59.660663 11570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "86b42dc2813b4be1b1cb2b0b55707017"
format_stamp: "Formatted at 2026-08-07 06:54:59 on dist-test-slave-tfpf"
server_key: "176aee7d134a8bd72fcfaf88896db69a"
server_key_iv: "4bf766c32883e6fd57e1b878724f5c43"
server_key_version: "encryptionkey@0"
I20260807 06:54:59.661449 11570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "86b42dc2813b4be1b1cb2b0b55707017"
format_stamp: "Formatted at 2026-08-07 06:54:59 on dist-test-slave-tfpf"
server_key: "176aee7d134a8bd72fcfaf88896db69a"
server_key_iv: "4bf766c32883e6fd57e1b878724f5c43"
server_key_version: "encryptionkey@0"
I20260807 06:54:59.666558 11570 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 06:54:59.670221 11595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:59.671490 11570 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:54:59.671653 11570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "86b42dc2813b4be1b1cb2b0b55707017"
format_stamp: "Formatted at 2026-08-07 06:54:59 on dist-test-slave-tfpf"
server_key: "176aee7d134a8bd72fcfaf88896db69a"
server_key_iv: "4bf766c32883e6fd57e1b878724f5c43"
server_key_version: "encryptionkey@0"
I20260807 06:54:59.671854 11570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:54:59.684423 11570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:54:59.689374 11570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:54:59.689724 11570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:54:59.690735 11570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:54:59.692277 11570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:54:59.692356 11570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:59.692464 11374 heartbeater.cc:503] Master 127.10.191.190:42209 was elected leader, sending a full tablet report...
I20260807 06:54:59.692520 11570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:54:59.692579 11570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:54:59.731273 11570 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:35203
I20260807 06:54:59.731355 11742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:35203 every 8 connection(s)
I20260807 06:54:59.732604 11570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:54:59.739441 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11570
I20260807 06:54:59.739709 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:54:59.740257 11006 external_mini_cluster.cc:1428] Setting key 3d40c4573960a1fd05e585a2a3479cb0
Aug 07 06:54:59 dist-test-slave-tfpf krb5kdc[11020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:54:59.753779 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:59.735413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:57865 (local address 127.10.191.190:42209)
0807 06:54:59.735895 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0807 06:54:59.735902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:54:59.736878 (+ 976us) server_negotiation.cc:407] Connection header received
0807 06:54:59.738770 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:54:59.738774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:54:59.738851 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:54:59.738954 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:54:59.741196 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.742307 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.744432 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.744849 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.744949 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:59.748462 (+ 3513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:54:59.748467 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:54:59.748471 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:54:59.748503 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:54:59.751056 (+ 2553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.751728 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.751731 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.751734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.751855 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.752247 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.752250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.752252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.752513 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:54:59.752627 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:54:59.753316 (+ 689us) server_negotiation.cc:299] Negotiation successful
0807 06:54:59.753490 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":214,"threads_started":1}
I20260807 06:54:59.754781 11750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:59.735988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42209 (local address 127.10.191.131:57865)
0807 06:54:59.736713 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0807 06:54:59.736752 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:54:59.738500 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:54:59.739274 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:54:59.739286 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:54:59.740079 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:54:59.740901 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:54:59.740931 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.742509 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.742516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:54:59.744281 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:54:59.744299 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.745047 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.745052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:54:59.745317 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:59.746025 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:54:59.746049 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:54:59.748238 (+ 2189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:54:59.751187 (+ 2949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:54:59.751194 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:54:59.751207 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:54:59.751623 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:54:59.751946 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:54:59.751949 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:54:59.751951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:54:59.752148 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:54:59.752616 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:54:59.752622 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:54:59.752938 (+ 316us) client_negotiation.cc:769] Sending connection context
0807 06:54:59.753234 (+ 296us) client_negotiation.cc:240] Negotiation successful
0807 06:54:59.753642 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":286,"threads_started":1}
I20260807 06:54:59.756536 11743 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42209
I20260807 06:54:59.756884 11743 heartbeater.cc:464] Registering TS with master...
I20260807 06:54:59.757704 11743 heartbeater.cc:511] Master 127.10.191.190:42209 requested a full tablet report, sending...
I20260807 06:54:59.759229 11087 ts_manager.cc:194] Registered new tserver with Master: 86b42dc2813b4be1b1cb2b0b55707017 (127.10.191.131:35203)
I20260807 06:54:59.760087 11087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:57865
I20260807 06:54:59.770015 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:54:59 dist-test-slave-tfpf krb5kdc[11020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:54:59 dist-test-slave-tfpf krb5kdc[11020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:54:59.824734 11756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:59.809280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42998 (local address 127.10.191.129:34247)
0807 06:54:59.810000 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0807 06:54:59.810008 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:54:59.810038 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:54:59.810126 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:54:59.810133 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:54:59.810372 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:54:59.810514 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:54:59.811998 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.813011 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.814301 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.814908 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.815041 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:59.819142 (+ 4101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:54:59.819156 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:54:59.819180 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:54:59.819221 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:54:59.822089 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.822722 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.822729 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.822731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.822881 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.823250 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.823253 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.823255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.823612 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:54:59.823858 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 06:54:59.824102 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 06:54:59.824317 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":396,"threads_started":1}
W20260807 06:54:59.826139 11242 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42998
Aug 07 06:54:59 dist-test-slave-tfpf krb5kdc[11020](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:54:59 dist-test-slave-tfpf krb5kdc[11020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:54:59.880113 11756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:59.866167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43008 (local address 127.10.191.129:34247)
0807 06:54:59.866425 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 06:54:59.866431 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:54:59.866559 (+ 128us) server_negotiation.cc:407] Connection header received
0807 06:54:59.866714 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:54:59.866718 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:54:59.866787 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:54:59.866874 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:54:59.868256 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.868975 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.870244 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.870665 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.870759 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:59.874720 (+ 3961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:54:59.874725 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:54:59.874729 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:54:59.874766 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:54:59.877542 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.878325 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.878330 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.878332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.878474 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.878817 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.878820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.878822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.879091 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:54:59.879272 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 06:54:59.879541 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 06:54:59.879720 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 06:54:59.881840 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11184
I20260807 06:54:59.895020 11756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:54:59.882866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43014 (local address 127.10.191.129:34247)
0807 06:54:59.883108 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 06:54:59.883115 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:54:59.883346 (+ 231us) server_negotiation.cc:407] Connection header received
0807 06:54:59.883465 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:54:59.883469 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:54:59.883527 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:54:59.883603 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:54:59.884774 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.885595 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.886894 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:54:59.887390 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:54:59.887485 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:54:59.889908 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:54:59.889913 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:54:59.889917 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:54:59.889949 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:54:59.892642 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.893320 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.893324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.893327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.893471 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:54:59.893794 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:54:59.893797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:54:59.893799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:54:59.894059 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:54:59.894240 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 06:54:59.894468 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 06:54:59.894631 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:54:59.895903 11367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:54:59.980819 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11184
I20260807 06:55:00.004063 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11385
Aug 07 06:55:00 dist-test-slave-tfpf krb5kdc[11020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:55:00.021261 11768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:00.004971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39632 (local address 127.10.191.130:44621)
0807 06:55:00.005652 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:00.005659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:00.005687 (+ 28us) server_negotiation.cc:407] Connection header received
0807 06:55:00.005753 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:00.005759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:00.005968 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:00.006109 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:00.007308 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:00.008387 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:00.009902 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:00.010451 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:00.010551 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:00.014903 (+ 4352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:00.014916 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:00.014933 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:00.015001 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:00.018284 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:00.018985 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:00.018993 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:00.018995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:00.019140 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:00.019499 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:00.019502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:00.019504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:00.019861 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:00.020120 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:00.020533 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 06:55:00.020754 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":390,"threads_started":1}
I20260807 06:55:00.022682 11557 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:00.105353 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11385
I20260807 06:55:00.132267 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11570
Aug 07 06:55:00 dist-test-slave-tfpf krb5kdc[11020](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:55:00.149791 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:00.133442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39310 (local address 127.10.191.131:35203)
0807 06:55:00.134102 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:00.134109 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:00.134138 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:55:00.134200 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:00.134206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:00.134412 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:00.134595 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:00.136001 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:00.137031 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:00.138474 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:00.139080 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:00.139247 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:00.143954 (+ 4707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:00.143967 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:00.143983 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:00.144020 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:00.146715 (+ 2695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:00.147404 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:00.147411 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:00.147413 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:00.147543 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:00.147933 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:00.147938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:00.147943 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:00.148322 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:00.148689 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:00.148989 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 06:55:00.149314 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":347,"threads_started":1}
I20260807 06:55:00.151127 11738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:00.233003 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11570
I20260807 06:55:00.259153 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11037
I20260807 06:55:00.260413 11138 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:00.365211 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11037
2026-08-07T06:55:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4337 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:00 dist-test-slave-tfpf krb5kdc[11778](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:00 dist-test-slave-tfpf krb5kdc[11778](info): set up 2 sockets
Aug 07 06:55:00 dist-test-slave-tfpf krb5kdc[11778](info): commencing operation
krb5kdc: starting...
W20260807 06:55:01.649590 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:01 dist-test-slave-tfpf krb5kdc[11778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:55:01.872532 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:44573
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:44573
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:02.221136 11796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:02.221506 11796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:02.221683 11796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:02.228991 11796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:02.229190 11796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:02.229305 11796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:02.229414 11796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:02.229503 11796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:02.239764 11796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:44573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:44573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:02.241302 11796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:02.242719 11796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:02.255638 11803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:02.255792 11807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:02.255875 11805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:02.256949 11796 server_base.cc:1034] running on GCE node
I20260807 06:55:02.257844 11796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:02.259361 11796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:02.260612 11796 hybrid_clock.cc:648] HybridClock initialized: now 1786085702260570 us; error 52 us; skew 500 ppm
I20260807 06:55:02.260972 11796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:02 dist-test-slave-tfpf krb5kdc[11778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085702, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:02.264218 11796 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:55:02.265901 11796 webserver.cc:460] Webserver started at http://127.10.191.190:33693/ using document root <none> and password file <none>
I20260807 06:55:02.266633 11796 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:02.266798 11796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:02.267153 11796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:02.270393 11796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "3baa322f12264bea9e932824afe572f5"
format_stamp: "Formatted at 2026-08-07 06:55:02 on dist-test-slave-tfpf"
server_key: "d0c466e86808c720061ecee2bf9511bd"
server_key_iv: "a1a122cc24014f13926c10cfb299a336"
server_key_version: "encryptionkey@0"
I20260807 06:55:02.271207 11796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "3baa322f12264bea9e932824afe572f5"
format_stamp: "Formatted at 2026-08-07 06:55:02 on dist-test-slave-tfpf"
server_key: "d0c466e86808c720061ecee2bf9511bd"
server_key_iv: "a1a122cc24014f13926c10cfb299a336"
server_key_version: "encryptionkey@0"
I20260807 06:55:02.276824 11796 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 06:55:02.280481 11817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:02.281915 11796 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:02.282109 11796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "3baa322f12264bea9e932824afe572f5"
format_stamp: "Formatted at 2026-08-07 06:55:02 on dist-test-slave-tfpf"
server_key: "d0c466e86808c720061ecee2bf9511bd"
server_key_iv: "a1a122cc24014f13926c10cfb299a336"
server_key_version: "encryptionkey@0"
I20260807 06:55:02.282322 11796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:02.311190 11796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:02.315611 11796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:02.315938 11796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:02.335623 11796 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:44573
I20260807 06:55:02.335628 11884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:44573 every 8 connection(s)
I20260807 06:55:02.337378 11796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:02.341320 11885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:02.344923 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11796
I20260807 06:55:02.345227 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:02.345872 11006 external_mini_cluster.cc:1428] Setting key faee4cc24222ed0a2c34e4c895bf3b97
I20260807 06:55:02.352896 11885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5: Bootstrap starting.
I20260807 06:55:02.356165 11885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:02.357288 11885 log.cc:824] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:02.360248 11885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5: No bootstrap required, opened a new log
Aug 07 06:55:02 dist-test-slave-tfpf krb5kdc[11778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:02.370119 11885 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3baa322f12264bea9e932824afe572f5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44573 } }
I20260807 06:55:02.370540 11885 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:02.370682 11885 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3baa322f12264bea9e932824afe572f5, State: Initialized, Role: FOLLOWER
I20260807 06:55:02.370801 11888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:02.347919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57928 (local address 127.10.191.190:44573)
0807 06:55:02.348879 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:02.348896 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:02.348953 (+ 57us) server_negotiation.cc:407] Connection header received
0807 06:55:02.351478 (+ 2525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:02.351502 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:02.351887 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:02.352269 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:02.353994 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:02.355351 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:02.356933 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:02.357776 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:02.357999 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:02.362659 (+ 4660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:02.362666 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:02.362680 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:02.362720 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:02.366021 (+ 3301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:02.366859 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:02.366865 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:02.366871 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:02.367076 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:02.367489 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:02.367492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:02.367494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:02.368094 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:02.368336 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:02.369015 (+ 679us) server_negotiation.cc:299] Negotiation successful
0807 06:55:02.369555 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":380,"threads_started":1}
I20260807 06:55:02.371345 11885 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3baa322f12264bea9e932824afe572f5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44573 } }
I20260807 06:55:02.371634 11885 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:02.371829 11885 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:02.372030 11885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:02.374439 11885 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3baa322f12264bea9e932824afe572f5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44573 } }
I20260807 06:55:02.374948 11885 leader_election.cc:302] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3baa322f12264bea9e932824afe572f5; no voters:
I20260807 06:55:02.375552 11885 leader_election.cc:288] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:02.375721 11891 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:02.377677 11885 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:02.378041 11891 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [term 1 LEADER]: Becoming Leader. State: Replica: 3baa322f12264bea9e932824afe572f5, State: Running, Role: LEADER
I20260807 06:55:02.378612 11891 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3baa322f12264bea9e932824afe572f5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44573 } }
I20260807 06:55:02.382027 11892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3baa322f12264bea9e932824afe572f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3baa322f12264bea9e932824afe572f5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44573 } } }
I20260807 06:55:02.382053 11894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3baa322f12264bea9e932824afe572f5. Latest consensus state: current_term: 1 leader_uuid: "3baa322f12264bea9e932824afe572f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3baa322f12264bea9e932824afe572f5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44573 } } }
I20260807 06:55:02.382494 11894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:02.382495 11892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:02.383391 11910 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:02.389438 11910 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:02.399513 11910 catalog_manager.cc:1347] Generated new cluster ID: 9415254e0da8445085afe038965baa74
I20260807 06:55:02.399646 11910 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:02.422845 11910 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:02.424482 11910 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:02.435254 11910 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3baa322f12264bea9e932824afe572f5: Generated new TSK 0
I20260807 06:55:02.436092 11910 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:55:02.509454 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44573
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:02.898229 11926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:02.898563 11926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:02.898669 11926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:02.906088 11926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:02.906217 11926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:02.906343 11926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:02.916354 11926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44573
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:02.917873 11926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:02.919355 11926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:02.933732 11934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:02.933936 11935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:02.933871 11937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:02.934824 11926 server_base.cc:1034] running on GCE node
I20260807 06:55:02.935582 11926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:02.936573 11926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:02.937779 11926 hybrid_clock.cc:648] HybridClock initialized: now 1786085702937728 us; error 43 us; skew 500 ppm
I20260807 06:55:02.938068 11926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:02 dist-test-slave-tfpf krb5kdc[11778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085702, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:02.941280 11926 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:55:02.942662 11926 webserver.cc:460] Webserver started at http://127.10.191.129:33919/ using document root <none> and password file <none>
I20260807 06:55:02.943320 11926 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:02.943423 11926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:02.943691 11926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:02.946717 11926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "2024e29a5c0f4adca5d6320b70eec853"
format_stamp: "Formatted at 2026-08-07 06:55:02 on dist-test-slave-tfpf"
server_key: "232e56c62fb0e713e0d31f0e6dea3321"
server_key_iv: "1af51d53e41b84040b911551363dfa24"
server_key_version: "encryptionkey@0"
I20260807 06:55:02.947458 11926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "2024e29a5c0f4adca5d6320b70eec853"
format_stamp: "Formatted at 2026-08-07 06:55:02 on dist-test-slave-tfpf"
server_key: "232e56c62fb0e713e0d31f0e6dea3321"
server_key_iv: "1af51d53e41b84040b911551363dfa24"
server_key_version: "encryptionkey@0"
I20260807 06:55:02.952893 11926 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 06:55:02.956578 11944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:02.958189 11926 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:02.958343 11926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "2024e29a5c0f4adca5d6320b70eec853"
format_stamp: "Formatted at 2026-08-07 06:55:02 on dist-test-slave-tfpf"
server_key: "232e56c62fb0e713e0d31f0e6dea3321"
server_key_iv: "1af51d53e41b84040b911551363dfa24"
server_key_version: "encryptionkey@0"
I20260807 06:55:02.958540 11926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:02.980866 11926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:02.985671 11926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:02.985960 11926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:02.987012 11926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:02.988464 11926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:02.988555 11926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:02.988741 11926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:02.988796 11926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:03.023182 11926 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:32777
I20260807 06:55:03.023264 12121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:32777 every 8 connection(s)
I20260807 06:55:03.024580 11926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:03.028230 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11926
I20260807 06:55:03.028463 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:03.029232 11006 external_mini_cluster.cc:1428] Setting key 09047cec059acd39caf9352447c0190b
Aug 07 06:55:03 dist-test-slave-tfpf krb5kdc[11778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085702, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:03.047339 12126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:03.027370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:52147 (local address 127.10.191.190:44573)
0807 06:55:03.027883 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:03.027890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:03.029001 (+ 1111us) server_negotiation.cc:407] Connection header received
0807 06:55:03.031449 (+ 2448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:03.031455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:03.031533 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:03.031651 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:03.033164 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:03.034261 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:03.035809 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:03.036476 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:03.036640 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:03.040639 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:03.040645 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:03.040648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:03.040688 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:03.043501 (+ 2813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:03.044600 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:03.044604 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:03.044606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:03.044757 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:03.045331 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:03.045334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:03.045336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:03.045615 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:03.045746 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:03.046852 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0807 06:55:03.047041 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":242,"threads_started":1}
I20260807 06:55:03.049038 12127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:03.027929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:44573 (local address 127.10.191.129:52147)
0807 06:55:03.028819 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:03.028867 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:03.031130 (+ 2263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:03.031865 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:03.031874 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:03.032386 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:03.032957 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:03.032974 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:03.034438 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:03.034441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:03.035654 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:03.035667 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:03.036706 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:03.036711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:03.036942 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:03.037712 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:03.037736 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:03.040386 (+ 2650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:03.043684 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:03.043697 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:03.043720 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:03.044462 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:03.044874 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:03.044881 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:03.044887 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:03.045206 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:03.045795 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:03.045808 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:03.046402 (+ 594us) client_negotiation.cc:769] Sending connection context
0807 06:55:03.046757 (+ 355us) client_negotiation.cc:240] Negotiation successful
0807 06:55:03.047390 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":355,"threads_started":1}
I20260807 06:55:03.051028 12124 heartbeater.cc:347] Connected to a master server at 127.10.191.190:44573
I20260807 06:55:03.051400 12124 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:03.052237 12124 heartbeater.cc:511] Master 127.10.191.190:44573 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
I20260807 06:55:03.054764 11837 ts_manager.cc:194] Registered new tserver with Master: 2024e29a5c0f4adca5d6320b70eec853 (127.10.191.129:32777)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
I20260807 06:55:03.056565 11837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:52147
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:55:03.082319 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44573
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:03.424549 12131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:03.424914 12131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:03.425107 12131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:03.432565 12131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:03.432740 12131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:03.432940 12131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:03.443241 12131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44573
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:03.444734 12131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:03.446228 12131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:03.459940 12137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:03.460028 12138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:03.460057 12140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:03.460868 12131 server_base.cc:1034] running on GCE node
I20260807 06:55:03.461656 12131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:03.462772 12131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:03.463984 12131 hybrid_clock.cc:648] HybridClock initialized: now 1786085703463906 us; error 60 us; skew 500 ppm
I20260807 06:55:03.464344 12131 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:03 dist-test-slave-tfpf krb5kdc[11778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085703, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:03.467792 12131 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:55:03.469487 12131 webserver.cc:460] Webserver started at http://127.10.191.130:35881/ using document root <none> and password file <none>
I20260807 06:55:03.470229 12131 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:03.470371 12131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:03.470736 12131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:03.473922 12131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "e4650f043fd24920a2d75bd7d0706127"
format_stamp: "Formatted at 2026-08-07 06:55:03 on dist-test-slave-tfpf"
server_key: "92b37086ca56448ba656ef63023776c7"
server_key_iv: "6aece397e6eb09ab92941b6c23cf2343"
server_key_version: "encryptionkey@0"
I20260807 06:55:03.474743 12131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "e4650f043fd24920a2d75bd7d0706127"
format_stamp: "Formatted at 2026-08-07 06:55:03 on dist-test-slave-tfpf"
server_key: "92b37086ca56448ba656ef63023776c7"
server_key_iv: "6aece397e6eb09ab92941b6c23cf2343"
server_key_version: "encryptionkey@0"
I20260807 06:55:03.480413 12131 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 06:55:03.484197 12149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:03.485674 12131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:03.485872 12131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "e4650f043fd24920a2d75bd7d0706127"
format_stamp: "Formatted at 2026-08-07 06:55:03 on dist-test-slave-tfpf"
server_key: "92b37086ca56448ba656ef63023776c7"
server_key_iv: "6aece397e6eb09ab92941b6c23cf2343"
server_key_version: "encryptionkey@0"
I20260807 06:55:03.486085 12131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:03.502676 12131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:03.507123 12131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:03.507457 12131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:03.508563 12131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:03.510131 12131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:03.510210 12131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:03.510383 12131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:03.510433 12131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:03.546226 12131 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:35169
I20260807 06:55:03.546286 12321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:35169 every 8 connection(s)
I20260807 06:55:03.547596 12131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:03.555052 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 12131
I20260807 06:55:03.555269 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:03.555845 11006 external_mini_cluster.cc:1428] Setting key b8995aace07c6ea18c7cc549281d5ced
Aug 07 06:55:03 dist-test-slave-tfpf krb5kdc[11778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085703, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:03.568823 12324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:03.550442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:47921 (local address 127.10.191.190:44573)
0807 06:55:03.550876 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:03.550881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:03.551903 (+ 1022us) server_negotiation.cc:407] Connection header received
0807 06:55:03.553850 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:03.553856 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:03.553950 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:03.554079 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:03.556131 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:03.556890 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:03.558549 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:03.559003 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:03.559142 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:03.563046 (+ 3904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:03.563051 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:03.563054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:03.563088 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:03.565681 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:03.566428 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:03.566440 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:03.566443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:03.566568 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:03.567031 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:03.567034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:03.567036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:03.567304 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:03.567462 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:03.568172 (+ 710us) server_negotiation.cc:299] Negotiation successful
0807 06:55:03.568403 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":218,"threads_started":1}
I20260807 06:55:03.569984 12325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:03.551017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:44573 (local address 127.10.191.130:47921)
0807 06:55:03.551746 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:03.551783 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:03.553572 (+ 1789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:03.554338 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:03.554347 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:03.555085 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:03.555930 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:03.555961 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:03.557107 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:03.557113 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:03.558389 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:03.558402 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:03.559257 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:03.559265 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:03.559499 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:03.560230 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:03.560259 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:03.562810 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:03.565828 (+ 3018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:03.565838 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:03.565856 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:03.566295 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:03.566684 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:03.566689 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:03.566692 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:03.566896 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:03.567434 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:03.567442 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:03.567806 (+ 364us) client_negotiation.cc:769] Sending connection context
0807 06:55:03.568082 (+ 276us) client_negotiation.cc:240] Negotiation successful
0807 06:55:03.568668 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":268,"threads_started":1}
I20260807 06:55:03.571645 12322 heartbeater.cc:347] Connected to a master server at 127.10.191.190:44573
I20260807 06:55:03.571964 12322 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:03.572764 12322 heartbeater.cc:511] Master 127.10.191.190:44573 requested a full tablet report, sending...
I20260807 06:55:03.574373 11837 ts_manager.cc:194] Registered new tserver with Master: e4650f043fd24920a2d75bd7d0706127 (127.10.191.130:35169)
I20260807 06:55:03.575217 11837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:47921
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:55:03.606420 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44573
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:03.956374 12328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:03.956755 12328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:03.956935 12328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:03.964450 12328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:03.964581 12328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:03.964705 12328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:03.975045 12328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44573
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:03.976418 12328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:03.978055 12328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:03.991999 12337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:03.992116 12336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:03.992091 12345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:03.993754 12328 server_base.cc:1034] running on GCE node
I20260807 06:55:03.994421 12328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:03.995468 12328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:03.996704 12328 hybrid_clock.cc:648] HybridClock initialized: now 1786085703996630 us; error 59 us; skew 500 ppm
I20260807 06:55:03.997045 12328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:03 dist-test-slave-tfpf krb5kdc[11778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085703, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:04.000430 12328 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:55:04.001964 12328 webserver.cc:460] Webserver started at http://127.10.191.131:41541/ using document root <none> and password file <none>
I20260807 06:55:04.002650 12328 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:04.002753 12328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:04.003054 12328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:04.006162 12328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "27282bff21994e1482f26a91fbc9af27"
format_stamp: "Formatted at 2026-08-07 06:55:03 on dist-test-slave-tfpf"
server_key: "8f36053915664d75bea7abe4800947e5"
server_key_iv: "97bed1896fa37f2526c2c8d76497c9c7"
server_key_version: "encryptionkey@0"
I20260807 06:55:04.006944 12328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "27282bff21994e1482f26a91fbc9af27"
format_stamp: "Formatted at 2026-08-07 06:55:03 on dist-test-slave-tfpf"
server_key: "8f36053915664d75bea7abe4800947e5"
server_key_iv: "97bed1896fa37f2526c2c8d76497c9c7"
server_key_version: "encryptionkey@0"
I20260807 06:55:04.012429 12328 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:55:04.016245 12353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:04.017768 12328 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:04.017958 12328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "27282bff21994e1482f26a91fbc9af27"
format_stamp: "Formatted at 2026-08-07 06:55:03 on dist-test-slave-tfpf"
server_key: "8f36053915664d75bea7abe4800947e5"
server_key_iv: "97bed1896fa37f2526c2c8d76497c9c7"
server_key_version: "encryptionkey@0"
I20260807 06:55:04.018219 12328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:04.039273 12328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:04.043936 12328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:04.044277 12328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:04.045383 12328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:04.046818 12328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:04.046898 12328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:04.047048 12328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:04.047103 12328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:04.060751 12124 heartbeater.cc:503] Master 127.10.191.190:44573 was elected leader, sending a full tablet report...
I20260807 06:55:04.083316 12328 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:40599
I20260807 06:55:04.083413 12534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:40599 every 8 connection(s)
I20260807 06:55:04.084688 12328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:04.089686 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 12328
I20260807 06:55:04.089910 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:04.090462 11006 external_mini_cluster.cc:1428] Setting key a51c2f133f4c675f948d81ceaa236dcf
Aug 07 06:55:04 dist-test-slave-tfpf krb5kdc[11778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085703, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:04.107429 12537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.087529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:54053 (local address 127.10.191.190:44573)
0807 06:55:04.088039 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.088046 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.089194 (+ 1148us) server_negotiation.cc:407] Connection header received
0807 06:55:04.091731 (+ 2537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.091736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.091849 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.092001 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:04.094103 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.094881 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.096473 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.096911 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.097014 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.100791 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:04.100796 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:04.100800 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:04.100836 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:04.103788 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.104769 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.104778 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.104782 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.104930 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.105516 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.105520 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.105522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.105904 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:04.106028 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.106944 (+ 916us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.107137 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":218,"threads_started":1}
I20260807 06:55:04.108448 12538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.088214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:44573 (local address 127.10.191.131:54053)
0807 06:55:04.088970 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:04.089010 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:04.091466 (+ 2456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:04.092343 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:04.092358 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:04.093164 (+ 806us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:04.093903 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.093932 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.095028 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.095032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.096330 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.096342 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.097245 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.097251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.097461 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.098135 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:04.098165 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:04.100555 (+ 2390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:04.103949 (+ 3394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:04.103957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:04.103971 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:04.104624 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:04.105104 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:04.105110 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:04.105114 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:04.105386 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:04.106034 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:04.106044 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:04.106491 (+ 447us) client_negotiation.cc:769] Sending connection context
0807 06:55:04.106837 (+ 346us) client_negotiation.cc:240] Negotiation successful
0807 06:55:04.107266 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":298,"threads_started":1}
I20260807 06:55:04.109895 12535 heartbeater.cc:347] Connected to a master server at 127.10.191.190:44573
I20260807 06:55:04.110235 12535 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:04.110991 12535 heartbeater.cc:511] Master 127.10.191.190:44573 requested a full tablet report, sending...
I20260807 06:55:04.112468 11837 ts_manager.cc:194] Registered new tserver with Master: 27282bff21994e1482f26a91fbc9af27 (127.10.191.131:40599)
I20260807 06:55:04.113387 11837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:54053
I20260807 06:55:04.118920 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:55:04.138724 12537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.125768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57930 (local address 127.10.191.190:44573)
0807 06:55:04.126005 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.126010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.126558 (+ 548us) server_negotiation.cc:407] Connection header received
0807 06:55:04.126717 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.126721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.126803 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.126896 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:04.128461 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.129327 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.130634 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.131040 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.131149 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.133612 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:04.133617 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:04.133620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:04.133655 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:04.136192 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.136883 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.136887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.136889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.137030 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.137431 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.137435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.137436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.137787 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:04.137978 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.138292 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.138482 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 06:55:04.145759 11837 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:04.152992 11837 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:04.188292 12557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.169487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47404 (local address 127.10.191.130:35169)
0807 06:55:04.178491 (+ 9004us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.178502 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.178533 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:55:04.178670 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.178678 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.178974 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.179252 (+ 278us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:04.180511 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.181858 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.185087 (+ 3229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.186947 (+ 1860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.187149 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.187341 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.187739 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.187916 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8602,"thread_start_us":8449,"threads_started":1}
I20260807 06:55:04.188321 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.166738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34488 (local address 127.10.191.129:32777)
0807 06:55:04.178704 (+ 11966us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.178713 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.178742 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:55:04.178849 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.178908 (+ 59us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.179176 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.179912 (+ 736us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:04.180769 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.182490 (+ 1721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.185447 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.186877 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.187525 (+ 648us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.187709 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.187786 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.187948 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11794,"thread_start_us":11626,"threads_started":1}
I20260807 06:55:04.188391 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.166434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:32777 (local address 127.0.0.1:34488)
0807 06:55:04.168180 (+ 1746us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:04.168235 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:04.168397 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:04.179432 (+ 11035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:04.179440 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:04.179486 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:04.180538 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.180549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.182667 (+ 2118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.182675 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.185183 (+ 2508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.185195 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.187208 (+ 2013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.187214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.187474 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.187519 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 06:55:04.187648 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 06:55:04.187917 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1492,"mutex_wait_us":226,"thread_start_us":1350,"threads_started":1}
I20260807 06:55:04.189086 12554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.166774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:40599 (local address 127.0.0.1:49714)
0807 06:55:04.177469 (+ 10695us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:04.177494 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:04.178703 (+ 1209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:04.179751 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:04.179758 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:04.179781 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:04.180511 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.180526 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.182776 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.182781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.185188 (+ 2407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.185203 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.188106 (+ 2903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.188114 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.188284 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.188331 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 06:55:04.188434 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 06:55:04.188582 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10511,"mutex_wait_us":186,"thread_start_us":10340,"threads_started":1}
I20260807 06:55:04.189383 12558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.169786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:35169 (local address 127.0.0.1:47404)
0807 06:55:04.177862 (+ 8076us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:04.177885 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:04.178062 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:04.179527 (+ 1465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:04.179530 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:04.179553 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:04.180287 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.180308 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.182039 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.182050 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.184852 (+ 2802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.184869 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.187196 (+ 2327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.187203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.187458 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.187533 (+ 75us) client_negotiation.cc:769] Sending connection context
0807 06:55:04.187652 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 06:55:04.187917 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7879,"mutex_wait_us":286,"thread_start_us":7698,"threads_started":1}
I20260807 06:55:04.190032 12555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.167560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49714 (local address 127.10.191.131:40599)
0807 06:55:04.169566 (+ 2006us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.169575 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.177655 (+ 8080us) server_negotiation.cc:407] Connection header received
0807 06:55:04.178930 (+ 1275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.178937 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.179152 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.179342 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:04.180825 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.182624 (+ 1799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.185394 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.186982 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.187176 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.187341 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.189407 (+ 2066us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.189602 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1822,"thread_start_us":1635,"threads_started":1}
I20260807 06:55:04.192792 12014 tablet_service.cc:1467] Processing CreateTablet for tablet aedb90dd6fa04ba28227242c6baccf51 (DEFAULT_TABLE table=test-table [id=685b8579b4e54c1a81ed8790eeed28a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:04.193339 12428 tablet_service.cc:1467] Processing CreateTablet for tablet aedb90dd6fa04ba28227242c6baccf51 (DEFAULT_TABLE table=test-table [id=685b8579b4e54c1a81ed8790eeed28a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:04.194332 12014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aedb90dd6fa04ba28227242c6baccf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:04.194854 12428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aedb90dd6fa04ba28227242c6baccf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:04.195902 12226 tablet_service.cc:1467] Processing CreateTablet for tablet aedb90dd6fa04ba28227242c6baccf51 (DEFAULT_TABLE table=test-table [id=685b8579b4e54c1a81ed8790eeed28a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:04.198261 12226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aedb90dd6fa04ba28227242c6baccf51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:04.207043 12563 tablet_bootstrap.cc:492] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853: Bootstrap starting.
I20260807 06:55:04.209905 12564 tablet_bootstrap.cc:492] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27: Bootstrap starting.
I20260807 06:55:04.210767 12563 tablet_bootstrap.cc:654] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:04.212205 12563 log.cc:824] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:04.213883 12564 tablet_bootstrap.cc:654] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:04.214517 12567 tablet_bootstrap.cc:492] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127: Bootstrap starting.
I20260807 06:55:04.215246 12564 log.cc:824] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:04.215947 12563 tablet_bootstrap.cc:492] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853: No bootstrap required, opened a new log
I20260807 06:55:04.216226 12563 ts_tablet_manager.cc:1397] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.001s
I20260807 06:55:04.218715 12567 tablet_bootstrap.cc:654] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:04.218750 12564 tablet_bootstrap.cc:492] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27: No bootstrap required, opened a new log
I20260807 06:55:04.219027 12564 ts_tablet_manager.cc:1397] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 06:55:04.219857 12567 log.cc:824] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:04.223205 12567 tablet_bootstrap.cc:492] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127: No bootstrap required, opened a new log
I20260807 06:55:04.223490 12567 ts_tablet_manager.cc:1397] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260807 06:55:04.227221 12563 raft_consensus.cc:348] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } }
I20260807 06:55:04.227743 12563 raft_consensus.cc:374] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:04.227846 12563 raft_consensus.cc:729] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2024e29a5c0f4adca5d6320b70eec853, State: Initialized, Role: FOLLOWER
I20260807 06:55:04.228529 12563 consensus_queue.cc:260] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } }
I20260807 06:55:04.229889 12564 raft_consensus.cc:348] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } }
I20260807 06:55:04.230392 12564 raft_consensus.cc:374] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:04.230491 12564 raft_consensus.cc:729] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27282bff21994e1482f26a91fbc9af27, State: Initialized, Role: FOLLOWER
I20260807 06:55:04.230732 12563 ts_tablet_manager.cc:1428] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853: Time spent starting tablet: real 0.014s user 0.012s sys 0.003s
I20260807 06:55:04.231233 12564 consensus_queue.cc:260] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } }
I20260807 06:55:04.232436 12535 heartbeater.cc:503] Master 127.10.191.190:44573 was elected leader, sending a full tablet report...
I20260807 06:55:04.232632 12567 raft_consensus.cc:348] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } }
I20260807 06:55:04.233139 12567 raft_consensus.cc:374] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:04.233268 12567 raft_consensus.cc:729] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4650f043fd24920a2d75bd7d0706127, State: Initialized, Role: FOLLOWER
I20260807 06:55:04.234001 12567 consensus_queue.cc:260] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } }
I20260807 06:55:04.234328 12564 ts_tablet_manager.cc:1428] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260807 06:55:04.235384 12322 heartbeater.cc:503] Master 127.10.191.190:44573 was elected leader, sending a full tablet report...
I20260807 06:55:04.236099 12567 ts_tablet_manager.cc:1428] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127: Time spent starting tablet: real 0.012s user 0.008s sys 0.005s
I20260807 06:55:04.251360 12575 raft_consensus.cc:482] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:04.251709 12575 raft_consensus.cc:504] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } }
I20260807 06:55:04.253505 12575 leader_election.cc:288] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2024e29a5c0f4adca5d6320b70eec853 (127.10.191.129:32777), 27282bff21994e1482f26a91fbc9af27 (127.10.191.131:40599)
I20260807 06:55:04.263497 12555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.254081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:40591 (local address 127.10.191.131:40599)
0807 06:55:04.254333 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.254342 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.255097 (+ 755us) server_negotiation.cc:407] Connection header received
0807 06:55:04.255394 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.255416 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.255500 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.255613 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:04.256427 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.257625 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.260892 (+ 3267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.262207 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.262383 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.262462 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.263098 (+ 636us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.263239 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 06:55:04.263518 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.254031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:35229 (local address 127.10.191.129:32777)
0807 06:55:04.254305 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.254314 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.255209 (+ 895us) server_negotiation.cc:407] Connection header received
0807 06:55:04.255479 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.255485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.255564 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.255656 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:04.256422 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.257625 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.260892 (+ 3267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.262227 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.262383 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.262462 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.263061 (+ 599us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.263228 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 06:55:04.263841 12577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.253797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:40599 (local address 127.10.191.130:40591)
0807 06:55:04.254966 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:04.254982 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:04.255210 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:04.255656 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:04.255661 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:04.255687 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:04.256238 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.256251 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.257777 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.257782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.260708 (+ 2926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.260726 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.262531 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.262535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.262803 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.262894 (+ 91us) client_negotiation.cc:769] Sending connection context
0807 06:55:04.262995 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 06:55:04.263229 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1005,"mutex_wait_us":349,"thread_start_us":791,"threads_started":1}
I20260807 06:55:04.263885 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.253807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:32777 (local address 127.10.191.130:35229)
0807 06:55:04.255073 (+ 1266us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:04.255088 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:04.255256 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:04.255671 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:04.255674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:04.255728 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:04.256239 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.256250 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.257778 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.257782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.260708 (+ 2926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:04.260726 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.262507 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.262519 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:04.262799 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.262894 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 06:55:04.262992 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:55:04.263229 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1137,"mutex_wait_us":400,"spinlock_wait_cycles":28928,"thread_start_us":583,"threads_started":1}
I20260807 06:55:04.264999 12042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aedb90dd6fa04ba28227242c6baccf51" candidate_uuid: "e4650f043fd24920a2d75bd7d0706127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2024e29a5c0f4adca5d6320b70eec853" is_pre_election: true
I20260807 06:55:04.264999 12462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aedb90dd6fa04ba28227242c6baccf51" candidate_uuid: "e4650f043fd24920a2d75bd7d0706127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27282bff21994e1482f26a91fbc9af27" is_pre_election: true
I20260807 06:55:04.265677 12042 raft_consensus.cc:2454] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4650f043fd24920a2d75bd7d0706127 in term 0.
I20260807 06:55:04.265677 12462 raft_consensus.cc:2454] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4650f043fd24920a2d75bd7d0706127 in term 0.
I20260807 06:55:04.266498 12150 leader_election.cc:302] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2024e29a5c0f4adca5d6320b70eec853, 27282bff21994e1482f26a91fbc9af27, e4650f043fd24920a2d75bd7d0706127; no voters:
I20260807 06:55:04.267079 12575 raft_consensus.cc:2781] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:04.267244 12575 raft_consensus.cc:482] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:04.267361 12575 raft_consensus.cc:3037] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:04.270020 12575 raft_consensus.cc:504] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } }
I20260807 06:55:04.270793 12575 leader_election.cc:288] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [CANDIDATE]: Term 1 election: Requested vote from peers 2024e29a5c0f4adca5d6320b70eec853 (127.10.191.129:32777), 27282bff21994e1482f26a91fbc9af27 (127.10.191.131:40599)
I20260807 06:55:04.271239 12042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aedb90dd6fa04ba28227242c6baccf51" candidate_uuid: "e4650f043fd24920a2d75bd7d0706127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2024e29a5c0f4adca5d6320b70eec853"
I20260807 06:55:04.271394 12462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aedb90dd6fa04ba28227242c6baccf51" candidate_uuid: "e4650f043fd24920a2d75bd7d0706127" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27282bff21994e1482f26a91fbc9af27"
I20260807 06:55:04.271482 12042 raft_consensus.cc:3037] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:04.271624 12462 raft_consensus.cc:3037] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:04.274974 12042 raft_consensus.cc:2454] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4650f043fd24920a2d75bd7d0706127 in term 1.
I20260807 06:55:04.274974 12462 raft_consensus.cc:2454] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4650f043fd24920a2d75bd7d0706127 in term 1.
I20260807 06:55:04.275458 12153 leader_election.cc:302] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27282bff21994e1482f26a91fbc9af27, e4650f043fd24920a2d75bd7d0706127; no voters:
I20260807 06:55:04.275851 12575 raft_consensus.cc:2781] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:04.276377 12575 raft_consensus.cc:686] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [term 1 LEADER]: Becoming Leader. State: Replica: e4650f043fd24920a2d75bd7d0706127, State: Running, Role: LEADER
I20260807 06:55:04.276934 12575 consensus_queue.cc:237] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } }
W20260807 06:55:04.277215 12125 tablet.cc:2369] T aedb90dd6fa04ba28227242c6baccf51 P 2024e29a5c0f4adca5d6320b70eec853: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:55:04.282696 11834 catalog_manager.cc:5495] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4650f043fd24920a2d75bd7d0706127 (127.10.191.130). New cstate: current_term: 1 leader_uuid: "e4650f043fd24920a2d75bd7d0706127" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2024e29a5c0f4adca5d6320b70eec853" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 32777 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27282bff21994e1482f26a91fbc9af27" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4650f043fd24920a2d75bd7d0706127" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 35169 } health_report { overall_health: HEALTHY } } }
W20260807 06:55:04.299819 12323 tablet.cc:2369] T aedb90dd6fa04ba28227242c6baccf51 P e4650f043fd24920a2d75bd7d0706127: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 06:55:04 dist-test-slave-tfpf krb5kdc[11778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:04.310585 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.295072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34492 (local address 127.10.191.129:32777)
0807 06:55:04.295331 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.295341 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.295705 (+ 364us) server_negotiation.cc:407] Connection header received
0807 06:55:04.295850 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.295854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.295921 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.296006 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:04.297736 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.298480 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.299834 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.300314 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.300421 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.304703 (+ 4282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:04.304719 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:04.304735 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:04.304770 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:04.307573 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.308320 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.308327 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.308330 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.308458 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.308868 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.308874 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.308878 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.309336 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:04.309690 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.309989 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.310221 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 06:55:04.336555 12536 tablet.cc:2369] T aedb90dd6fa04ba28227242c6baccf51 P 27282bff21994e1482f26a91fbc9af27: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 06:55:04 dist-test-slave-tfpf krb5kdc[11778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085704, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:55:04 dist-test-slave-tfpf krb5kdc[11778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085704, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:04.370518 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.355023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34498 (local address 127.10.191.129:32777)
0807 06:55:04.355324 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.355330 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.355567 (+ 237us) server_negotiation.cc:407] Connection header received
0807 06:55:04.355709 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.355713 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.355776 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.355862 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:04.357494 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.358315 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.359680 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.360129 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.360290 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.364811 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:04.364817 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:04.364820 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:04.364862 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:04.367546 (+ 2684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.368274 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.368285 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.368288 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.368447 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.368908 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.368913 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.368920 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.369291 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:04.369604 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.369888 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.370138 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
Aug 07 06:55:04 dist-test-slave-tfpf krb5kdc[11778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:55:04 dist-test-slave-tfpf krb5kdc[11778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:04.427102 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.412410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34500 (local address 127.10.191.129:32777)
0807 06:55:04.412675 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.412684 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.413001 (+ 317us) server_negotiation.cc:407] Connection header received
0807 06:55:04.413300 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.413305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.413375 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.413500 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:04.414997 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.415723 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.416999 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.417535 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.417680 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.421915 (+ 4235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:04.421920 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:04.421923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:04.422003 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:04.424459 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.425264 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.425268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.425271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.425398 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.425748 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.425751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.425753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.426065 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:04.426343 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.426633 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.426837 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260807 06:55:04.429001 11986 tablet_service.cc:2908] Rejecting scan request for tablet aedb90dd6fa04ba28227242c6baccf51: Uninitialized: clean time has not yet been initialized
I20260807 06:55:04.432053 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11926
I20260807 06:55:04.444505 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.432986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34508 (local address 127.10.191.129:32777)
0807 06:55:04.433197 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.433202 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.433573 (+ 371us) server_negotiation.cc:407] Connection header received
0807 06:55:04.433724 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.433727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.433781 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.433860 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:04.434977 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.435630 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.436730 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.437229 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.437334 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.439531 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:04.439536 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:04.439539 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:04.439571 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:04.442283 (+ 2712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.442931 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.442935 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.442937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.443058 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.443373 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.443376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.443378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.443688 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:04.443910 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.444103 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.444278 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:55:04.445248 12115 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:04.537868 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11926
I20260807 06:55:04.571321 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 12131
Aug 07 06:55:04 dist-test-slave-tfpf krb5kdc[11778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:55:04.588088 12557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.572307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47412 (local address 127.10.191.130:35169)
0807 06:55:04.572511 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.572517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.572541 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:55:04.572635 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.572639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.572708 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.572823 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:04.574081 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.575235 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.576528 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.577204 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.577322 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.581753 (+ 4431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:04.581767 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:04.581784 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:04.581821 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:04.584825 (+ 3004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.585886 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.585895 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.585897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.586089 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.586575 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.586580 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.586582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.587122 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:04.587371 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.587611 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.587810 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 06:55:04.588932 12316 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:04.684614 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 12131
I20260807 06:55:04.712036 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 12328
Aug 07 06:55:04 dist-test-slave-tfpf krb5kdc[11778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:55:04.728230 12555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:04.712971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49716 (local address 127.10.191.131:40599)
0807 06:55:04.713191 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:04.713199 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:04.713224 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:55:04.713461 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:04.713466 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:04.713534 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:04.713655 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:04.715019 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.715793 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.717424 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:04.717864 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:04.718030 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:04.722574 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:04.722591 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:04.722607 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:04.722651 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:04.725555 (+ 2904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.726293 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.726301 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.726303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.726434 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:04.726794 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:04.726801 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:04.726805 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:04.727193 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:04.727410 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:04.727669 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 06:55:04.727868 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:55:04.728946 12525 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:04.816002 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 12328
I20260807 06:55:04.842640 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11796
I20260807 06:55:04.843918 11877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:04.953586 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11796
2026-08-07T06:55:04Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4591 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:05 dist-test-slave-tfpf krb5kdc[12608](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:05 dist-test-slave-tfpf krb5kdc[12608](info): set up 2 sockets
Aug 07 06:55:05 dist-test-slave-tfpf krb5kdc[12608](info): commencing operation
krb5kdc: starting...
W20260807 06:55:06.202247 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:06 dist-test-slave-tfpf krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:55:06.435907 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:43515
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:43515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:06.799048 12623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:06.799419 12623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:06.799561 12623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:06.806524 12623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:06.806653 12623 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 06:55:06.806697 12623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:06.806770 12623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:06.806813 12623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:06.806872 12623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:06.816651 12623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:43515
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:43515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:06.818136 12623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:06.819463 12623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:06.831799 12631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:06.831799 12633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:06.832115 12635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:06.832674 12623 server_base.cc:1034] running on GCE node
I20260807 06:55:06.833561 12623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:06.835129 12623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:06.836357 12623 hybrid_clock.cc:648] HybridClock initialized: now 1786085706836273 us; error 55 us; skew 500 ppm
I20260807 06:55:06.836740 12623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:06 dist-test-slave-tfpf krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:06.840188 12623 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:55:06.841861 12623 webserver.cc:460] Webserver started at http://127.10.191.190:41085/ using document root <none> and password file <none>
I20260807 06:55:06.842657 12623 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:06.842789 12623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:06.843163 12623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:06.846199 12623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "31a2fa46172a44d6a7353c66e3e17e17"
format_stamp: "Formatted at 2026-08-07 06:55:06 on dist-test-slave-tfpf"
server_key: "489cab6689c6d7ee311107350fc5d55f"
server_key_iv: "06a4a78bd346baceea2f41e27024596b"
server_key_version: "encryptionkey@0"
I20260807 06:55:06.846990 12623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "31a2fa46172a44d6a7353c66e3e17e17"
format_stamp: "Formatted at 2026-08-07 06:55:06 on dist-test-slave-tfpf"
server_key: "489cab6689c6d7ee311107350fc5d55f"
server_key_iv: "06a4a78bd346baceea2f41e27024596b"
server_key_version: "encryptionkey@0"
I20260807 06:55:06.852610 12623 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:55:06.856194 12649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:06.857607 12623 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:06.857800 12623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "31a2fa46172a44d6a7353c66e3e17e17"
format_stamp: "Formatted at 2026-08-07 06:55:06 on dist-test-slave-tfpf"
server_key: "489cab6689c6d7ee311107350fc5d55f"
server_key_iv: "06a4a78bd346baceea2f41e27024596b"
server_key_version: "encryptionkey@0"
I20260807 06:55:06.858037 12623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:06.899639 12623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:06.903898 12623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:06.904209 12623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:06.927647 12623 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:43515
I20260807 06:55:06.927654 12739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:43515 every 8 connection(s)
I20260807 06:55:06.929174 12623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:06.933290 12741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:06.934161 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 12623
I20260807 06:55:06.934401 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:06.935321 11006 external_mini_cluster.cc:1428] Setting key 62b6814ca3ecfdc41b3b2d1f25efff75
I20260807 06:55:06.948997 12741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17: Bootstrap starting.
Aug 07 06:55:06 dist-test-slave-tfpf krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:06.952874 12741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:06.954496 12741 log.cc:824] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:06.958276 12741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17: No bootstrap required, opened a new log
I20260807 06:55:06.961424 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:06.937669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36700 (local address 127.10.191.190:43515)
0807 06:55:06.938571 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:06.938587 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:06.938646 (+ 59us) server_negotiation.cc:407] Connection header received
0807 06:55:06.940746 (+ 2100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:06.940780 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:06.941356 (+ 576us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:06.941826 (+ 470us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:06.943134 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:06.945234 (+ 2100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:06.946501 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:06.947564 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:06.947752 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:06.952186 (+ 4434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:06.952198 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:06.952218 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:06.952272 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:06.956262 (+ 3990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:06.957111 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:06.957123 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:06.957135 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:06.957387 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:06.957797 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:06.957802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:06.957805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:06.958591 (+ 786us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:06.958942 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:06.959333 (+ 391us) server_negotiation.cc:299] Negotiation successful
0807 06:55:06.959812 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":372,"threads_started":1}
I20260807 06:55:06.967818 12741 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a2fa46172a44d6a7353c66e3e17e17" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43515 } }
I20260807 06:55:06.968262 12741 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:06.968398 12741 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a2fa46172a44d6a7353c66e3e17e17, State: Initialized, Role: FOLLOWER
I20260807 06:55:06.969143 12741 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a2fa46172a44d6a7353c66e3e17e17" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43515 } }
I20260807 06:55:06.969448 12741 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:06.969619 12741 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:06.969861 12741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:06.973404 12741 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a2fa46172a44d6a7353c66e3e17e17" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43515 } }
I20260807 06:55:06.974144 12741 leader_election.cc:302] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31a2fa46172a44d6a7353c66e3e17e17; no voters:
I20260807 06:55:06.974910 12741 leader_election.cc:288] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:06.975147 12750 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:06.976044 12750 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [term 1 LEADER]: Becoming Leader. State: Replica: 31a2fa46172a44d6a7353c66e3e17e17, State: Running, Role: LEADER
I20260807 06:55:06.976650 12750 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a2fa46172a44d6a7353c66e3e17e17" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43515 } }
I20260807 06:55:06.977434 12741 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:06.979679 12751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31a2fa46172a44d6a7353c66e3e17e17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a2fa46172a44d6a7353c66e3e17e17" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43515 } } }
I20260807 06:55:06.980121 12751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:06.979763 12752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31a2fa46172a44d6a7353c66e3e17e17. Latest consensus state: current_term: 1 leader_uuid: "31a2fa46172a44d6a7353c66e3e17e17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a2fa46172a44d6a7353c66e3e17e17" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43515 } } }
I20260807 06:55:06.980862 12752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:06.980968 12756 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:06.986301 12756 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:06.997665 12756 catalog_manager.cc:1347] Generated new cluster ID: ff09ee1e6a42480f848cf1ffdc9f5bab
I20260807 06:55:06.997807 12756 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:07.032364 12756 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:07.033900 12756 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:07.041991 12756 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17: Generated new TSK 0
I20260807 06:55:07.043187 12756 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:55:07.107232 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:43515
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:07.461788 12779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:07.462229 12779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:07.462417 12779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:07.469748 12779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:07.469879 12779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:07.470043 12779 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:55:07.470197 12779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:07.480631 12779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.191.190:43515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:07.482172 12779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:07.483649 12779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:07.497491 12787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:07.497426 12792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:07.497465 12797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:07.498409 12779 server_base.cc:1034] running on GCE node
I20260807 06:55:07.499015 12779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:07.499975 12779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:07.501194 12779 hybrid_clock.cc:648] HybridClock initialized: now 1786085707501131 us; error 45 us; skew 500 ppm
I20260807 06:55:07.501477 12779 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:07 dist-test-slave-tfpf krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085707, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:07.504738 12779 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:55:07.506348 12779 webserver.cc:460] Webserver started at http://127.10.191.129:42707/ using document root <none> and password file <none>
I20260807 06:55:07.507081 12779 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:07.507205 12779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:07.507553 12779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:07.510716 12779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "b3b1ac98ad6448639ad1abae2057bfad"
format_stamp: "Formatted at 2026-08-07 06:55:07 on dist-test-slave-tfpf"
server_key: "4c766111e33338e879bf6950832eee48"
server_key_iv: "de62a12f122f845458e789050c547c1e"
server_key_version: "encryptionkey@0"
I20260807 06:55:07.511574 12779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "b3b1ac98ad6448639ad1abae2057bfad"
format_stamp: "Formatted at 2026-08-07 06:55:07 on dist-test-slave-tfpf"
server_key: "4c766111e33338e879bf6950832eee48"
server_key_iv: "de62a12f122f845458e789050c547c1e"
server_key_version: "encryptionkey@0"
I20260807 06:55:07.517511 12779 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260807 06:55:07.521534 12807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:07.523077 12779 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:55:07.523272 12779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "b3b1ac98ad6448639ad1abae2057bfad"
format_stamp: "Formatted at 2026-08-07 06:55:07 on dist-test-slave-tfpf"
server_key: "4c766111e33338e879bf6950832eee48"
server_key_iv: "de62a12f122f845458e789050c547c1e"
server_key_version: "encryptionkey@0"
I20260807 06:55:07.523524 12779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:07.545583 12779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:07.549757 12779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:07.550065 12779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:07.552855 12779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:07.552984 12779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:07.553174 12779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:07.553259 12779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:55:07 dist-test-slave-tfpf krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085707, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:07.577890 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:07.553740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:36027 (local address 127.10.191.190:43515)
0807 06:55:07.554216 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:07.554222 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:07.555539 (+ 1317us) server_negotiation.cc:407] Connection header received
0807 06:55:07.558743 (+ 3204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:07.558750 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:07.558851 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:07.558998 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:07.561683 (+ 2685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:07.562841 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:07.565471 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:07.566100 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:07.566242 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:07.570400 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:07.570405 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:07.570408 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:07.570468 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:07.573934 (+ 3466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:07.574829 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:07.574838 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:07.574844 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:07.575042 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:07.575544 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:07.575552 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:07.575558 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:07.576038 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:07.576265 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:07.577024 (+ 759us) server_negotiation.cc:299] Negotiation successful
0807 06:55:07.577368 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":229,"threads_started":1}
I20260807 06:55:07.579216 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:07.554406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43515 (local address 127.10.191.129:36027)
0807 06:55:07.555344 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:07.555404 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:07.558286 (+ 2882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:07.559371 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:07.559385 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:07.560393 (+ 1008us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:07.561492 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:07.561524 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:07.563051 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:07.563055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:07.565297 (+ 2242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:07.565314 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:07.566358 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:07.566367 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:07.566613 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:07.567435 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:07.567461 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:07.570112 (+ 2651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:07.574091 (+ 3979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:07.574101 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:07.574119 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:07.574655 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:07.575187 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:07.575193 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:07.575197 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:07.575402 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:07.576187 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:07.576193 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:07.576555 (+ 362us) client_negotiation.cc:769] Sending connection context
0807 06:55:07.576829 (+ 274us) client_negotiation.cc:240] Negotiation successful
0807 06:55:07.577449 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":353,"threads_started":1}
I20260807 06:55:07.604300 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:07.586363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:52307 (local address 127.10.191.190:43515)
0807 06:55:07.586587 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:07.586596 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:07.587278 (+ 682us) server_negotiation.cc:407] Connection header received
0807 06:55:07.587440 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:07.587449 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:07.587562 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:07.587707 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:07.588666 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:07.590119 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:07.593116 (+ 2997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:07.593627 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:07.593758 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:07.596951 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:07.596957 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:07.596960 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:07.596995 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:07.600627 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:07.601805 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:07.601812 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:07.601815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:07.601995 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:07.602518 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:07.602524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:07.602528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:07.602958 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:07.603131 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:07.603563 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 06:55:07.603944 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 06:55:07.604358 12916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:07.586474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43515 (local address 127.10.191.129:52307)
0807 06:55:07.587151 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:07.587184 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:07.587310 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:07.587727 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:07.587730 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:07.588216 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:07.588509 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:07.588518 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:07.590401 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:07.590412 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:07.592771 (+ 2359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:07.592799 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:07.593904 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:07.593913 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:07.594205 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:07.595088 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:07.595123 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:07.596691 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:07.600795 (+ 4104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:07.600801 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:07.600807 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:07.601605 (+ 798us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:07.602156 (+ 551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:07.602163 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:07.602182 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:07.602365 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:07.603106 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:07.603111 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:07.603304 (+ 193us) client_negotiation.cc:769] Sending connection context
0807 06:55:07.603460 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 06:55:07.603831 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":367,"threads_started":1}
I20260807 06:55:07.615262 12779 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:44381
I20260807 06:55:07.615301 12996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:44381 every 8 connection(s)
I20260807 06:55:07.616547 12779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:07.618806 12999 heartbeater.cc:347] Connected to a master server at 127.10.191.190:43515
I20260807 06:55:07.619117 12999 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:07.619812 12999 heartbeater.cc:511] Master 127.10.191.190:43515 requested a full tablet report, sending...
I20260807 06:55:07.622010 12671 ts_manager.cc:194] Registered new tserver with Master: b3b1ac98ad6448639ad1abae2057bfad (127.10.191.129:44381)
I20260807 06:55:07.623519 12671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:36027
I20260807 06:55:07.624569 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 12779
I20260807 06:55:07.624827 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:07.625551 11006 external_mini_cluster.cc:1428] Setting key 665c4b3bc91912c25395437aa904c462
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:55:07.674357 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:43515
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:08.018077 13007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:08.018443 13007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:08.018647 13007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:08.026022 13007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:08.026197 13007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:08.026350 13007 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:55:08.026486 13007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:08.036845 13007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.191.190:43515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:08.038322 13007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:08.039814 13007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:08.054145 13015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:08.054232 13013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:08.054199 13020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:08.055375 13007 server_base.cc:1034] running on GCE node
I20260807 06:55:08.056062 13007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:08.057183 13007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:08.058458 13007 hybrid_clock.cc:648] HybridClock initialized: now 1786085708058385 us; error 57 us; skew 500 ppm
I20260807 06:55:08.058809 13007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:08 dist-test-slave-tfpf krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085708, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:08.067111 13007 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:55:08.068833 13007 webserver.cc:460] Webserver started at http://127.10.191.130:45621/ using document root <none> and password file <none>
I20260807 06:55:08.069734 13007 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:08.069883 13007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:08.070274 13007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:08.073441 13007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "418af3faf5e34bd59eb3c678004593b9"
format_stamp: "Formatted at 2026-08-07 06:55:08 on dist-test-slave-tfpf"
server_key: "48d07332440f7719613c727b158c62f4"
server_key_iv: "4d0613e509caf3d60b26162e39e1d78d"
server_key_version: "encryptionkey@0"
I20260807 06:55:08.074267 13007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "418af3faf5e34bd59eb3c678004593b9"
format_stamp: "Formatted at 2026-08-07 06:55:08 on dist-test-slave-tfpf"
server_key: "48d07332440f7719613c727b158c62f4"
server_key_iv: "4d0613e509caf3d60b26162e39e1d78d"
server_key_version: "encryptionkey@0"
I20260807 06:55:08.079963 13007 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260807 06:55:08.083958 13032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:08.085501 13007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:08.085718 13007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "418af3faf5e34bd59eb3c678004593b9"
format_stamp: "Formatted at 2026-08-07 06:55:08 on dist-test-slave-tfpf"
server_key: "48d07332440f7719613c727b158c62f4"
server_key_iv: "4d0613e509caf3d60b26162e39e1d78d"
server_key_version: "encryptionkey@0"
I20260807 06:55:08.085981 13007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:08.114619 13007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:08.119112 13007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:08.119424 13007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:08.122419 13007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:08.122540 13007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:08.122746 13007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:08.122840 13007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:55:08 dist-test-slave-tfpf krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085708, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:08.152240 13049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.122949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:58621 (local address 127.10.191.190:43515)
0807 06:55:08.123801 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:08.123807 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:08.124899 (+ 1092us) server_negotiation.cc:407] Connection header received
0807 06:55:08.128178 (+ 3279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:08.128187 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:08.128304 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:08.128423 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:08.131940 (+ 3517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.133097 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.136971 (+ 3874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.137931 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.138074 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.143672 (+ 5598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:08.143684 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:08.143691 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:08.143754 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:08.148158 (+ 4404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.149508 (+ 1350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.149515 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.149519 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.149715 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.150327 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.150334 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.150337 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.150621 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:08.150787 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:08.151601 (+ 814us) server_negotiation.cc:299] Negotiation successful
0807 06:55:08.151847 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":574,"threads_started":1}
I20260807 06:55:08.153378 13054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.123724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43515 (local address 127.10.191.130:58621)
0807 06:55:08.124681 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:08.124754 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:08.127730 (+ 2976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:08.129189 (+ 1459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:08.129206 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:08.130364 (+ 1158us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:08.131662 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.131703 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.133285 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.133297 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.136690 (+ 3393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.136712 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.138580 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.138591 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.139047 (+ 456us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.140065 (+ 1018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:08.140113 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:08.143384 (+ 3271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:08.148388 (+ 5004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:08.148406 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:08.148429 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:08.149333 (+ 904us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:08.149894 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:08.149898 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:08.149903 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:08.150183 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:08.150767 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:08.150776 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:08.151196 (+ 420us) client_negotiation.cc:769] Sending connection context
0807 06:55:08.151473 (+ 277us) client_negotiation.cc:240] Negotiation successful
0807 06:55:08.152047 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":378,"threads_started":1}
I20260807 06:55:08.175608 13172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.160634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43515 (local address 127.10.191.130:36735)
0807 06:55:08.161510 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:08.161548 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:08.161691 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:08.162122 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:08.162126 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:08.162656 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:08.163024 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.163038 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.164751 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.164754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.166183 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.166196 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.166977 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.166983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.167148 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.167809 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:08.167827 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:08.168586 (+ 759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:08.172482 (+ 3896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:08.172487 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:08.172491 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:08.172922 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:08.173350 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:08.173355 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:08.173359 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:08.173594 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:08.174444 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:08.174448 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:08.174636 (+ 188us) client_negotiation.cc:769] Sending connection context
0807 06:55:08.174764 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 06:55:08.175138 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":536,"threads_started":1}
I20260807 06:55:08.175729 13049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.160401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:36735 (local address 127.10.191.190:43515)
0807 06:55:08.160646 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:08.160652 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:08.161662 (+ 1010us) server_negotiation.cc:407] Connection header received
0807 06:55:08.161806 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:08.161816 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:08.161971 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:08.162112 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:08.163176 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.164606 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.166357 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.166778 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.166929 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.168783 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:08.168794 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:08.168797 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:08.168832 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:08.172331 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.173052 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.173096 (+ 44us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.173100 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.173228 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.173777 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.173782 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.173785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.174295 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:08.174468 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:08.174915 (+ 447us) server_negotiation.cc:299] Negotiation successful
0807 06:55:08.175253 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 06:55:08.186870 13007 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:38593
I20260807 06:55:08.186890 13231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:38593 every 8 connection(s)
I20260807 06:55:08.188249 13007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:08.189888 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 13007
I20260807 06:55:08.190117 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:08.190541 11006 external_mini_cluster.cc:1428] Setting key 62fa59186e255d334b1658513fa648de
I20260807 06:55:08.192142 13233 heartbeater.cc:347] Connected to a master server at 127.10.191.190:43515
I20260807 06:55:08.192411 13233 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:08.193284 13233 heartbeater.cc:511] Master 127.10.191.190:43515 requested a full tablet report, sending...
I20260807 06:55:08.194826 12670 ts_manager.cc:194] Registered new tserver with Master: 418af3faf5e34bd59eb3c678004593b9 (127.10.191.130:38593)
I20260807 06:55:08.195691 12670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:58621
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:55:08.241858 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:43515
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:08.591580 13241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:08.591899 13241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:08.592113 13241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:08.599469 13241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:08.599594 13241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:08.599754 13241 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:55:08.599893 13241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:08.611310 13241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.191.190:43515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:08.612740 13241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:08.614269 13241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 06:55:08.626837 12999 heartbeater.cc:503] Master 127.10.191.190:43515 was elected leader, sending a full tablet report...
W20260807 06:55:08.628328 13249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:08.629966 13248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:08.630419 13252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:08.630867 13241 server_base.cc:1034] running on GCE node
I20260807 06:55:08.631619 13241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:08.632613 13241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:08.633859 13241 hybrid_clock.cc:648] HybridClock initialized: now 1786085708633800 us; error 29 us; skew 500 ppm
I20260807 06:55:08.634127 13241 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:08 dist-test-slave-tfpf krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085708, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:08.637554 13241 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:55:08.639077 13241 webserver.cc:460] Webserver started at http://127.10.191.131:36077/ using document root <none> and password file <none>
I20260807 06:55:08.639815 13241 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:08.639909 13241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:08.640244 13241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:08.643287 13241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "cee22496beaa46e68d79876c5c147420"
format_stamp: "Formatted at 2026-08-07 06:55:08 on dist-test-slave-tfpf"
server_key: "edb0b7d1c225ec2c384d5d444c0176de"
server_key_iv: "cd42e384d1813fa77f4433ce0c33193e"
server_key_version: "encryptionkey@0"
I20260807 06:55:08.644083 13241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "cee22496beaa46e68d79876c5c147420"
format_stamp: "Formatted at 2026-08-07 06:55:08 on dist-test-slave-tfpf"
server_key: "edb0b7d1c225ec2c384d5d444c0176de"
server_key_iv: "cd42e384d1813fa77f4433ce0c33193e"
server_key_version: "encryptionkey@0"
I20260807 06:55:08.649528 13241 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 06:55:08.653275 13264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:08.654729 13241 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:55:08.654927 13241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "cee22496beaa46e68d79876c5c147420"
format_stamp: "Formatted at 2026-08-07 06:55:08 on dist-test-slave-tfpf"
server_key: "edb0b7d1c225ec2c384d5d444c0176de"
server_key_iv: "cd42e384d1813fa77f4433ce0c33193e"
server_key_version: "encryptionkey@0"
I20260807 06:55:08.655151 13241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:08.675261 13241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:08.679919 13241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:08.680222 13241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:08.683521 13241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:08.683637 13241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:08.683768 13241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:08.683840 13241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:55:08 dist-test-slave-tfpf krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085708, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:08.710891 13284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.684241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:57145 (local address 127.10.191.190:43515)
0807 06:55:08.684873 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:08.684877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:08.686161 (+ 1284us) server_negotiation.cc:407] Connection header received
0807 06:55:08.688445 (+ 2284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:08.688454 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:08.688563 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:08.688718 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:08.691644 (+ 2926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.692962 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.695143 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.695904 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.696075 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.702425 (+ 6350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:08.702435 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:08.702443 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:08.702496 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:08.706607 (+ 4111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.707513 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.707522 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.707528 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.707707 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.708462 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.708469 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.708473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.708875 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:08.709147 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:08.710369 (+ 1222us) server_negotiation.cc:299] Negotiation successful
0807 06:55:08.710572 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":415,"threads_started":1}
I20260807 06:55:08.712990 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.685178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43515 (local address 127.10.191.131:57145)
0807 06:55:08.685980 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:08.686027 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:08.688024 (+ 1997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:08.689040 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:08.689055 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:08.690144 (+ 1089us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:08.691346 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.691388 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.693195 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.693203 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.694964 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.694980 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.696253 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.696261 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.696599 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.697499 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:08.697541 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:08.702011 (+ 4470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:08.706831 (+ 4820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:08.706839 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:08.706855 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:08.707353 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:08.707913 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:08.707920 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:08.707925 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:08.708297 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:08.709128 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:08.709146 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:08.709805 (+ 659us) client_negotiation.cc:769] Sending connection context
0807 06:55:08.710219 (+ 414us) client_negotiation.cc:240] Negotiation successful
0807 06:55:08.710989 (+ 770us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":327,"threads_started":1}
I20260807 06:55:08.739705 13407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.721441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43515 (local address 127.10.191.131:50779)
0807 06:55:08.722304 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:08.722331 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:08.722596 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:08.723371 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:08.723377 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:08.724064 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:08.724512 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.724531 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.726052 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.726065 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.727712 (+ 1647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.727727 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.729015 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.729023 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.729266 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.729998 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:08.730018 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:08.730965 (+ 947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:08.735764 (+ 4799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:08.735773 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:08.735783 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:08.736632 (+ 849us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:08.737303 (+ 671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:08.737311 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:08.737317 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:08.737524 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:08.738413 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:08.738419 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:08.738779 (+ 360us) client_negotiation.cc:769] Sending connection context
0807 06:55:08.739000 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 06:55:08.739316 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":476,"threads_started":1}
I20260807 06:55:08.740058 13284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.721391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:50779 (local address 127.10.191.190:43515)
0807 06:55:08.721630 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:08.721639 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:08.722451 (+ 812us) server_negotiation.cc:407] Connection header received
0807 06:55:08.722868 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:08.722875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:08.722995 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:08.723130 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:08.724731 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.725835 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.727891 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.728763 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.728941 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.731363 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:08.731374 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:08.731382 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:08.731436 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:08.735520 (+ 4084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.736849 (+ 1329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.736855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.736857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.737109 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.737741 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.737750 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.737756 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.738221 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:08.738712 (+ 491us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:08.739158 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 06:55:08.739506 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 06:55:08.744834 13241 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:34537
I20260807 06:55:08.744859 13453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:34537 every 8 connection(s)
I20260807 06:55:08.746246 13241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:08.748451 13455 heartbeater.cc:347] Connected to a master server at 127.10.191.190:43515
I20260807 06:55:08.748698 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 13241
I20260807 06:55:08.748739 13455 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:08.748916 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:08.749560 11006 external_mini_cluster.cc:1428] Setting key c79a9dfbe80fc6061267776e662b5cf4
I20260807 06:55:08.749696 13455 heartbeater.cc:511] Master 127.10.191.190:43515 requested a full tablet report, sending...
I20260807 06:55:08.751427 12670 ts_manager.cc:194] Registered new tserver with Master: cee22496beaa46e68d79876c5c147420 (127.10.191.131:34537)
I20260807 06:55:08.752544 12670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:57145
I20260807 06:55:08.753108 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:55:08 dist-test-slave-tfpf krb5kdc[12608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:55:08 dist-test-slave-tfpf krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:08.812513 13284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.797414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36716 (local address 127.10.191.190:43515)
0807 06:55:08.797715 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:08.797721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:08.798001 (+ 280us) server_negotiation.cc:407] Connection header received
0807 06:55:08.798246 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:08.798251 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:08.798334 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:08.798449 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:08.799973 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.800732 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.802190 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.802630 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.802793 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.806956 (+ 4163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:08.806962 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:08.806966 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:08.807007 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:08.809804 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.810512 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.810517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.810519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.810667 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:08.811030 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:08.811062 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:08.811067 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:08.811393 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:08.811642 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:08.811904 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 06:55:08.812100 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 06:55:08.817530 12670 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:08.824682 12670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:08.851344 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.839009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49160 (local address 127.10.191.130:38593)
0807 06:55:08.841646 (+ 2637us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:08.841654 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:08.841697 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:55:08.841807 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:08.841815 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:08.842096 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:08.842316 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:08.843314 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.844755 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.847590 (+ 2835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.849020 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.849235 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.849429 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:08.850855 (+ 1426us) server_negotiation.cc:299] Negotiation successful
0807 06:55:08.851028 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2476,"thread_start_us":2326,"threads_started":1}
I20260807 06:55:08.851389 13472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.838771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:38593 (local address 127.0.0.1:49160)
0807 06:55:08.840012 (+ 1241us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:08.840061 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:08.840265 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:08.842609 (+ 2344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:08.842617 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:08.842652 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:08.843125 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.843138 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.844936 (+ 1798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.844942 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.847395 (+ 2453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.847406 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.849579 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.849589 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.850548 (+ 959us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.850618 (+ 70us) client_negotiation.cc:769] Sending connection context
0807 06:55:08.850795 (+ 177us) client_negotiation.cc:240] Negotiation successful
0807 06:55:08.850998 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":993,"mutex_wait_us":667,"thread_start_us":865,"threads_started":1}
I20260807 06:55:08.854064 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.838961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:44381 (local address 127.0.0.1:34444)
0807 06:55:08.842698 (+ 3737us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:08.842719 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:08.842936 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:08.843839 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:08.843844 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:08.843869 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:08.844256 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.844268 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.847408 (+ 3140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.847413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.850992 (+ 3579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.851000 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.853257 (+ 2257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.853263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.853443 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.853481 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 06:55:08.853593 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 06:55:08.853739 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2479,"thread_start_us":2316,"threads_started":1}
I20260807 06:55:08.854331 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.839678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34444 (local address 127.10.191.129:44381)
0807 06:55:08.841208 (+ 1530us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:08.841219 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:08.842823 (+ 1604us) server_negotiation.cc:407] Connection header received
0807 06:55:08.843180 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:08.843192 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:08.843426 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:08.843596 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:08.844432 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.847174 (+ 2742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.851146 (+ 3972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.852741 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.852930 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.853190 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:08.853668 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 06:55:08.853836 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1313,"thread_start_us":1165,"threads_started":1}
I20260807 06:55:08.856580 13123 tablet_service.cc:1467] Processing CreateTablet for tablet 4beb7964c7584e96a8353f684fc914b2 (DEFAULT_TABLE table=test-table [id=0a80498b70bc419ca020a6168551297e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:08.858341 13123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4beb7964c7584e96a8353f684fc914b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:08.859970 13479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.841682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:34537 (local address 127.0.0.1:55046)
0807 06:55:08.850657 (+ 8975us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:08.850690 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:08.850809 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:08.851936 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:08.851940 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:08.851966 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:08.852311 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.852322 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.854264 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.854269 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.856647 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:08.856669 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.859067 (+ 2398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.859091 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:08.859299 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.859333 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 06:55:08.859443 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 06:55:08.859598 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8814,"thread_start_us":8645,"threads_started":1}
I20260807 06:55:08.860895 13480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:08.842139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55046 (local address 127.10.191.131:34537)
0807 06:55:08.850200 (+ 8061us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:08.850209 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:08.851166 (+ 957us) server_negotiation.cc:407] Connection header received
0807 06:55:08.851271 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:08.851279 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:08.851713 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:08.851925 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:08.852548 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.853966 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.856883 (+ 2917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:08.858552 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:08.858750 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:08.858913 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:08.860354 (+ 1441us) server_negotiation.cc:299] Negotiation successful
0807 06:55:08.860570 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7867,"thread_start_us":7690,"threads_started":1}
I20260807 06:55:08.861263 12884 tablet_service.cc:1467] Processing CreateTablet for tablet 4beb7964c7584e96a8353f684fc914b2 (DEFAULT_TABLE table=test-table [id=0a80498b70bc419ca020a6168551297e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:08.862985 12884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4beb7964c7584e96a8353f684fc914b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:08.873200 13481 tablet_bootstrap.cc:492] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: Bootstrap starting.
I20260807 06:55:08.873659 13348 tablet_service.cc:1467] Processing CreateTablet for tablet 4beb7964c7584e96a8353f684fc914b2 (DEFAULT_TABLE table=test-table [id=0a80498b70bc419ca020a6168551297e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:08.875180 13348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4beb7964c7584e96a8353f684fc914b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:08.877230 13481 tablet_bootstrap.cc:654] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:08.878016 13482 tablet_bootstrap.cc:492] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: Bootstrap starting.
I20260807 06:55:08.879585 13481 log.cc:824] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:08.882117 13482 tablet_bootstrap.cc:654] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:08.882764 13481 tablet_bootstrap.cc:492] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: No bootstrap required, opened a new log
I20260807 06:55:08.883060 13481 ts_tablet_manager.cc:1397] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260807 06:55:08.883453 13482 log.cc:824] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:08.886751 13482 tablet_bootstrap.cc:492] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: No bootstrap required, opened a new log
I20260807 06:55:08.887045 13482 ts_tablet_manager.cc:1397] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260807 06:55:08.891428 13486 tablet_bootstrap.cc:492] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: Bootstrap starting.
I20260807 06:55:08.891651 13481 raft_consensus.cc:348] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:08.892423 13481 raft_consensus.cc:374] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:08.892546 13481 raft_consensus.cc:729] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 418af3faf5e34bd59eb3c678004593b9, State: Initialized, Role: FOLLOWER
I20260807 06:55:08.893262 13481 consensus_queue.cc:260] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:08.894541 13233 heartbeater.cc:503] Master 127.10.191.190:43515 was elected leader, sending a full tablet report...
I20260807 06:55:08.895233 13481 ts_tablet_manager.cc:1428] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: Time spent starting tablet: real 0.012s user 0.003s sys 0.009s
I20260807 06:55:08.895792 13486 tablet_bootstrap.cc:654] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:08.897023 13486 log.cc:824] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:08.898591 13482 raft_consensus.cc:348] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:08.899153 13482 raft_consensus.cc:374] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:08.899282 13482 raft_consensus.cc:729] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b1ac98ad6448639ad1abae2057bfad, State: Initialized, Role: FOLLOWER
I20260807 06:55:08.899950 13482 consensus_queue.cc:260] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:08.900345 13486 tablet_bootstrap.cc:492] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: No bootstrap required, opened a new log
I20260807 06:55:08.900676 13486 ts_tablet_manager.cc:1397] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260807 06:55:08.902087 13482 ts_tablet_manager.cc:1428] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260807 06:55:08.910234 13486 raft_consensus.cc:348] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:08.910657 13486 raft_consensus.cc:374] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:08.910732 13486 raft_consensus.cc:729] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cee22496beaa46e68d79876c5c147420, State: Initialized, Role: FOLLOWER
I20260807 06:55:08.911269 13486 consensus_queue.cc:260] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:08.912313 13455 heartbeater.cc:503] Master 127.10.191.190:43515 was elected leader, sending a full tablet report...
I20260807 06:55:08.913028 13486 ts_tablet_manager.cc:1428] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: Time spent starting tablet: real 0.012s user 0.005s sys 0.008s
W20260807 06:55:08.940399 13234 tablet.cc:2369] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:55:08.997910 13456 tablet.cc:2369] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:55:09.089946 13487 raft_consensus.cc:482] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:09.090374 13487 raft_consensus.cc:504] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.092192 13487 leader_election.cc:288] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3b1ac98ad6448639ad1abae2057bfad (127.10.191.129:44381), cee22496beaa46e68d79876c5c147420 (127.10.191.131:34537)
I20260807 06:55:09.100704 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.092748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:49121 (local address 127.10.191.129:44381)
0807 06:55:09.093029 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.093034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.093692 (+ 658us) server_negotiation.cc:407] Connection header received
0807 06:55:09.093930 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.093938 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.094031 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.094164 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:09.095108 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.096180 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.098489 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.099687 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.099833 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.099895 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.100346 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.100460 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260807 06:55:09.101153 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.092735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:44381 (local address 127.10.191.130:49121)
0807 06:55:09.093568 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:09.093590 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:09.093740 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:09.094460 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:09.094470 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:09.094501 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:09.094938 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.094950 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.096337 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.096343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.098311 (+ 1968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.098324 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.099929 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.099937 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.100127 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.100179 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 06:55:09.100285 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 06:55:09.100444 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"mutex_wait_us":3,"thread_start_us":468,"threads_started":1}
I20260807 06:55:09.101729 13480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.094118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:40577 (local address 127.10.191.131:34537)
0807 06:55:09.094395 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.094404 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.094961 (+ 557us) server_negotiation.cc:407] Connection header received
0807 06:55:09.095185 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.095189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.095247 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.095315 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:09.095984 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.097044 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.099436 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.100543 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.100720 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.100792 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.101320 (+ 528us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.101464 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 06:55:09.101815 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.093742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:34537 (local address 127.10.191.130:40577)
0807 06:55:09.094805 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:09.094843 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:09.095037 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:09.095369 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:09.095374 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:09.095404 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:09.095826 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.095839 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.097337 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.097341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.099253 (+ 1912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.099271 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.100815 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.100822 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.101082 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.101133 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 06:55:09.101290 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 06:55:09.101429 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"mutex_wait_us":23,"thread_start_us":666,"threads_started":1}
I20260807 06:55:09.102490 12929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4beb7964c7584e96a8353f684fc914b2" candidate_uuid: "418af3faf5e34bd59eb3c678004593b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b1ac98ad6448639ad1abae2057bfad" is_pre_election: true
I20260807 06:55:09.102717 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4beb7964c7584e96a8353f684fc914b2" candidate_uuid: "418af3faf5e34bd59eb3c678004593b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee22496beaa46e68d79876c5c147420" is_pre_election: true
I20260807 06:55:09.103127 12929 raft_consensus.cc:2454] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 418af3faf5e34bd59eb3c678004593b9 in term 0.
I20260807 06:55:09.103318 13375 raft_consensus.cc:2454] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 418af3faf5e34bd59eb3c678004593b9 in term 0.
I20260807 06:55:09.103905 13036 leader_election.cc:302] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 418af3faf5e34bd59eb3c678004593b9, b3b1ac98ad6448639ad1abae2057bfad; no voters:
I20260807 06:55:09.104282 13487 raft_consensus.cc:2781] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:09.104504 13487 raft_consensus.cc:482] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:09.104643 13487 raft_consensus.cc:3037] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:09.107235 13487 raft_consensus.cc:504] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.107975 13487 leader_election.cc:288] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [CANDIDATE]: Term 1 election: Requested vote from peers b3b1ac98ad6448639ad1abae2057bfad (127.10.191.129:44381), cee22496beaa46e68d79876c5c147420 (127.10.191.131:34537)
I20260807 06:55:09.108582 12929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4beb7964c7584e96a8353f684fc914b2" candidate_uuid: "418af3faf5e34bd59eb3c678004593b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b1ac98ad6448639ad1abae2057bfad"
I20260807 06:55:09.108662 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4beb7964c7584e96a8353f684fc914b2" candidate_uuid: "418af3faf5e34bd59eb3c678004593b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee22496beaa46e68d79876c5c147420"
I20260807 06:55:09.108840 12929 raft_consensus.cc:3037] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:09.108958 13375 raft_consensus.cc:3037] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:09.111481 12929 raft_consensus.cc:2454] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 418af3faf5e34bd59eb3c678004593b9 in term 1.
I20260807 06:55:09.111738 13375 raft_consensus.cc:2454] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 418af3faf5e34bd59eb3c678004593b9 in term 1.
I20260807 06:55:09.112049 13036 leader_election.cc:302] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 418af3faf5e34bd59eb3c678004593b9, b3b1ac98ad6448639ad1abae2057bfad; no voters:
I20260807 06:55:09.112394 13487 raft_consensus.cc:2781] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:09.112860 13487 raft_consensus.cc:686] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 1 LEADER]: Becoming Leader. State: Replica: 418af3faf5e34bd59eb3c678004593b9, State: Running, Role: LEADER
I20260807 06:55:09.113426 13487 consensus_queue.cc:237] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.118507 12671 catalog_manager.cc:5495] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 418af3faf5e34bd59eb3c678004593b9 (127.10.191.130). New cstate: current_term: 1 leader_uuid: "418af3faf5e34bd59eb3c678004593b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } health_report { overall_health: UNKNOWN } } }
W20260807 06:55:09.119669 13000 tablet.cc:2369] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:55:09.154393 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.149028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49174 (local address 127.10.191.130:38593)
0807 06:55:09.149269 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.149274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.149295 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:55:09.149531 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.149536 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.149631 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.149765 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:09.150136 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.150844 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.152216 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.152623 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.152750 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.153291 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:09.153832 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:09.153947 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.154093 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.154174 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260807 06:55:09.163242 13375 raft_consensus.cc:1261] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Refusing update from remote peer 418af3faf5e34bd59eb3c678004593b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:09.163595 12929 raft_consensus.cc:1261] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Refusing update from remote peer 418af3faf5e34bd59eb3c678004593b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:09.164374 13504 consensus_queue.cc:1035] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:09.164796 13487 consensus_queue.cc:1035] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:09.201594 12671 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:09.201932 12671 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:09.206498 12671 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17: Sending DeleteTablet for 3 replicas of tablet 4beb7964c7584e96a8353f684fc914b2
I20260807 06:55:09.207865 13123 tablet_service.cc:1514] Processing DeleteTablet for tablet 4beb7964c7584e96a8353f684fc914b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:09 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:49160
I20260807 06:55:09.208010 12884 tablet_service.cc:1514] Processing DeleteTablet for tablet 4beb7964c7584e96a8353f684fc914b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:09 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:34444
I20260807 06:55:09.208256 13348 tablet_service.cc:1514] Processing DeleteTablet for tablet 4beb7964c7584e96a8353f684fc914b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:09 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:55046
I20260807 06:55:09.213896 12671 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:09.215161 12671 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:09.218799 13527 tablet_replica.cc:330] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: stopping tablet replica
I20260807 06:55:09.219336 13527 raft_consensus.cc:2229] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:09.219905 13527 raft_consensus.cc:2258] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:09.223342 13524 tablet_replica.cc:330] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: stopping tablet replica
I20260807 06:55:09.223884 13524 raft_consensus.cc:2229] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:09.224426 13524 raft_consensus.cc:2258] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:09.227133 13527 ts_tablet_manager.cc:1905] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:09.228539 13122 tablet_service.cc:1467] Processing CreateTablet for tablet e2db51b0c43f4e738803918fe11e056a (DEFAULT_TABLE table=test-table [id=c521d342cac3476986a74969e8e18376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:09.230067 13348 tablet_service.cc:1467] Processing CreateTablet for tablet e2db51b0c43f4e738803918fe11e056a (DEFAULT_TABLE table=test-table [id=c521d342cac3476986a74969e8e18376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:09.230536 13348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2db51b0c43f4e738803918fe11e056a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:09.230893 12884 tablet_service.cc:1467] Processing CreateTablet for tablet e2db51b0c43f4e738803918fe11e056a (DEFAULT_TABLE table=test-table [id=c521d342cac3476986a74969e8e18376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:09.231297 13122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2db51b0c43f4e738803918fe11e056a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:09.231698 12884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2db51b0c43f4e738803918fe11e056a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:09.232807 13524 ts_tablet_manager.cc:1905] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:09.239121 13523 tablet_replica.cc:330] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: stopping tablet replica
I20260807 06:55:09.239658 13523 raft_consensus.cc:2229] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:09.240213 13481 tablet_bootstrap.cc:492] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: Bootstrap starting.
I20260807 06:55:09.240442 13523 raft_consensus.cc:2258] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:09.241904 13482 tablet_bootstrap.cc:492] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: Bootstrap starting.
I20260807 06:55:09.242004 13481 tablet_bootstrap.cc:654] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:09.243270 13486 tablet_bootstrap.cc:492] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: Bootstrap starting.
I20260807 06:55:09.243644 13482 tablet_bootstrap.cc:654] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:09.245086 13486 tablet_bootstrap.cc:654] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:09.246107 13482 tablet_bootstrap.cc:492] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: No bootstrap required, opened a new log
I20260807 06:55:09.246280 13482 ts_tablet_manager.cc:1397] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 06:55:09.247124 13482 raft_consensus.cc:348] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.247349 13482 raft_consensus.cc:374] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:09.247452 13482 raft_consensus.cc:729] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b1ac98ad6448639ad1abae2057bfad, State: Initialized, Role: FOLLOWER
I20260807 06:55:09.247766 13482 consensus_queue.cc:260] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.248288 13527 ts_tablet_manager.cc:1918] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:09.248347 13482 ts_tablet_manager.cc:1428] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 06:55:09.248473 13527 log.cc:1196] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/4beb7964c7584e96a8353f684fc914b2
I20260807 06:55:09.253502 13524 ts_tablet_manager.cc:1918] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:09.253732 13524 log.cc:1196] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/4beb7964c7584e96a8353f684fc914b2
I20260807 06:55:09.254379 13524 ts_tablet_manager.cc:1939] T 4beb7964c7584e96a8353f684fc914b2 P b3b1ac98ad6448639ad1abae2057bfad: Deleting consensus metadata
I20260807 06:55:09.256789 12652 catalog_manager.cc:4841] TS b3b1ac98ad6448639ad1abae2057bfad (127.10.191.129:44381): tablet 4beb7964c7584e96a8353f684fc914b2 (table test-table [id=0a80498b70bc419ca020a6168551297e]) successfully deleted
I20260807 06:55:09.249150 13527 ts_tablet_manager.cc:1939] T 4beb7964c7584e96a8353f684fc914b2 P cee22496beaa46e68d79876c5c147420: Deleting consensus metadata
I20260807 06:55:09.257874 13523 ts_tablet_manager.cc:1905] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:09.259083 13486 tablet_bootstrap.cc:492] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: No bootstrap required, opened a new log
I20260807 06:55:09.259258 13486 ts_tablet_manager.cc:1397] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.002s
I20260807 06:55:09.259289 12652 catalog_manager.cc:4841] TS cee22496beaa46e68d79876c5c147420 (127.10.191.131:34537): tablet 4beb7964c7584e96a8353f684fc914b2 (table test-table [id=0a80498b70bc419ca020a6168551297e]) successfully deleted
I20260807 06:55:09.260154 13486 raft_consensus.cc:348] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.260440 13486 raft_consensus.cc:374] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:09.260542 13486 raft_consensus.cc:729] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cee22496beaa46e68d79876c5c147420, State: Initialized, Role: FOLLOWER
I20260807 06:55:09.260840 13486 consensus_queue.cc:260] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.262188 13486 ts_tablet_manager.cc:1428] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:09.267429 13481 tablet_bootstrap.cc:492] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: No bootstrap required, opened a new log
I20260807 06:55:09.267620 13481 ts_tablet_manager.cc:1397] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.009s
I20260807 06:55:09.268363 13481 raft_consensus.cc:348] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.268652 13481 raft_consensus.cc:374] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:09.268784 13481 raft_consensus.cc:729] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 418af3faf5e34bd59eb3c678004593b9, State: Initialized, Role: FOLLOWER
I20260807 06:55:09.269137 13481 consensus_queue.cc:260] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.269842 13481 ts_tablet_manager.cc:1428] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 06:55:09.270852 13523 ts_tablet_manager.cc:1918] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:09.271049 13523 log.cc:1196] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/4beb7964c7584e96a8353f684fc914b2
I20260807 06:55:09.271593 13523 ts_tablet_manager.cc:1939] T 4beb7964c7584e96a8353f684fc914b2 P 418af3faf5e34bd59eb3c678004593b9: Deleting consensus metadata
I20260807 06:55:09.273550 12650 catalog_manager.cc:4841] TS 418af3faf5e34bd59eb3c678004593b9 (127.10.191.130:38593): tablet 4beb7964c7584e96a8353f684fc914b2 (table test-table [id=0a80498b70bc419ca020a6168551297e]) successfully deleted
I20260807 06:55:09.399326 13504 raft_consensus.cc:482] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:09.399662 13504 raft_consensus.cc:504] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.400576 13504 leader_election.cc:288] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3b1ac98ad6448639ad1abae2057bfad (127.10.191.129:44381), cee22496beaa46e68d79876c5c147420 (127.10.191.131:34537)
I20260807 06:55:09.401438 12929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2db51b0c43f4e738803918fe11e056a" candidate_uuid: "418af3faf5e34bd59eb3c678004593b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b1ac98ad6448639ad1abae2057bfad" is_pre_election: true
I20260807 06:55:09.401530 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2db51b0c43f4e738803918fe11e056a" candidate_uuid: "418af3faf5e34bd59eb3c678004593b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee22496beaa46e68d79876c5c147420" is_pre_election: true
I20260807 06:55:09.401724 12929 raft_consensus.cc:2454] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 418af3faf5e34bd59eb3c678004593b9 in term 0.
I20260807 06:55:09.401811 13375 raft_consensus.cc:2454] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 418af3faf5e34bd59eb3c678004593b9 in term 0.
I20260807 06:55:09.402216 13036 leader_election.cc:302] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 418af3faf5e34bd59eb3c678004593b9, b3b1ac98ad6448639ad1abae2057bfad; no voters:
I20260807 06:55:09.402596 13504 raft_consensus.cc:2781] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:09.402720 13504 raft_consensus.cc:482] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:09.402848 13504 raft_consensus.cc:3037] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:09.406337 13504 raft_consensus.cc:504] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.407155 13504 leader_election.cc:288] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [CANDIDATE]: Term 1 election: Requested vote from peers b3b1ac98ad6448639ad1abae2057bfad (127.10.191.129:44381), cee22496beaa46e68d79876c5c147420 (127.10.191.131:34537)
I20260807 06:55:09.407761 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2db51b0c43f4e738803918fe11e056a" candidate_uuid: "418af3faf5e34bd59eb3c678004593b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cee22496beaa46e68d79876c5c147420"
I20260807 06:55:09.407773 12929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2db51b0c43f4e738803918fe11e056a" candidate_uuid: "418af3faf5e34bd59eb3c678004593b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b1ac98ad6448639ad1abae2057bfad"
I20260807 06:55:09.408005 13375 raft_consensus.cc:3037] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:09.408015 12929 raft_consensus.cc:3037] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:09.410219 13375 raft_consensus.cc:2454] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 418af3faf5e34bd59eb3c678004593b9 in term 1.
I20260807 06:55:09.410717 13036 leader_election.cc:302] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 418af3faf5e34bd59eb3c678004593b9, cee22496beaa46e68d79876c5c147420; no voters:
I20260807 06:55:09.411060 13504 raft_consensus.cc:2781] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:09.411222 12929 raft_consensus.cc:2454] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 418af3faf5e34bd59eb3c678004593b9 in term 1.
I20260807 06:55:09.411743 13504 raft_consensus.cc:686] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 1 LEADER]: Becoming Leader. State: Replica: 418af3faf5e34bd59eb3c678004593b9, State: Running, Role: LEADER
I20260807 06:55:09.412053 13504 consensus_queue.cc:237] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.414975 12671 catalog_manager.cc:5495] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 418af3faf5e34bd59eb3c678004593b9 (127.10.191.130). New cstate: current_term: 1 leader_uuid: "418af3faf5e34bd59eb3c678004593b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } health_report { overall_health: UNKNOWN } } }
Aug 07 06:55:09 dist-test-slave-tfpf krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:09.497605 13542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.479946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36732 (local address 127.10.191.190:43515)
0807 06:55:09.481177 (+ 1231us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.481181 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.481214 (+ 33us) server_negotiation.cc:407] Connection header received
0807 06:55:09.481262 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.481265 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.481317 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.481404 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:09.483015 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.483747 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.485579 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.485969 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.486065 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.490463 (+ 4398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:09.490474 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:09.490478 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:09.490520 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:09.494526 (+ 4006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:09.495416 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:09.495423 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:09.495427 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:09.495578 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:09.495951 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:09.495958 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:09.495961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:09.496275 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:09.496433 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.496847 (+ 414us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.497249 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":193,"server-negotiator.queue_time_us":1066,"thread_start_us":874,"threads_started":1}
I20260807 06:55:09.497628 13543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.479919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43515 (local address 127.0.0.1:36732)
0807 06:55:09.480716 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:09.480741 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:09.480937 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:09.481545 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:09.481551 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:09.482525 (+ 974us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:09.482842 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.482859 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.483910 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.483916 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.485422 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.485447 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.486150 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.486161 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.486346 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.487116 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:09.487144 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:09.490173 (+ 3029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:09.494697 (+ 4524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:09.494710 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:09.494716 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:09.495290 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:09.495692 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:09.495697 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:09.495701 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:09.495841 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:09.496405 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:09.496413 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:09.496589 (+ 176us) client_negotiation.cc:769] Sending connection context
0807 06:55:09.496769 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 06:55:09.497125 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":3,"thread_start_us":391,"threads_started":1}
I20260807 06:55:09.503242 12671 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:36732:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 06:55:09.504426 12671 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:09.512549 12884 tablet_service.cc:1467] Processing CreateTablet for tablet f29f7a00e4864bee9812b749136289d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=94fd6b4f249f4538b8c570e12ae8e9dd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:55:09.512719 13122 tablet_service.cc:1467] Processing CreateTablet for tablet f29f7a00e4864bee9812b749136289d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=94fd6b4f249f4538b8c570e12ae8e9dd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:55:09.512833 13348 tablet_service.cc:1467] Processing CreateTablet for tablet f29f7a00e4864bee9812b749136289d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=94fd6b4f249f4538b8c570e12ae8e9dd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:55:09.513361 13122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f29f7a00e4864bee9812b749136289d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:09.513367 13348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f29f7a00e4864bee9812b749136289d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:09.513358 12884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f29f7a00e4864bee9812b749136289d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:09.521512 13486 tablet_bootstrap.cc:492] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: Bootstrap starting.
I20260807 06:55:09.523641 13481 tablet_bootstrap.cc:492] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: Bootstrap starting.
I20260807 06:55:09.523710 13486 tablet_bootstrap.cc:654] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:09.525904 13481 tablet_bootstrap.cc:654] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:09.527840 13482 tablet_bootstrap.cc:492] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: Bootstrap starting.
I20260807 06:55:09.529702 13482 tablet_bootstrap.cc:654] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:09.531200 13481 tablet_bootstrap.cc:492] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: No bootstrap required, opened a new log
I20260807 06:55:09.531399 13481 ts_tablet_manager.cc:1397] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260807 06:55:09.532198 13481 raft_consensus.cc:348] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.532511 13481 raft_consensus.cc:374] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:09.532604 13481 raft_consensus.cc:729] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 418af3faf5e34bd59eb3c678004593b9, State: Initialized, Role: FOLLOWER
I20260807 06:55:09.532936 13481 consensus_queue.cc:260] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.533646 13504 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.533959 13504 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:09.534299 13486 tablet_bootstrap.cc:492] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: No bootstrap required, opened a new log
I20260807 06:55:09.534503 13482 tablet_bootstrap.cc:492] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: No bootstrap required, opened a new log
I20260807 06:55:09.534552 13486 ts_tablet_manager.cc:1397] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.009s
I20260807 06:55:09.534720 13482 ts_tablet_manager.cc:1397] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260807 06:55:09.535509 13482 raft_consensus.cc:348] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.535528 13486 raft_consensus.cc:348] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.535769 13482 raft_consensus.cc:374] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:09.535840 13482 raft_consensus.cc:729] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b1ac98ad6448639ad1abae2057bfad, State: Initialized, Role: FOLLOWER
I20260807 06:55:09.535954 13486 raft_consensus.cc:374] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:09.536132 13482 consensus_queue.cc:260] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.536096 13486 raft_consensus.cc:729] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cee22496beaa46e68d79876c5c147420, State: Initialized, Role: FOLLOWER
I20260807 06:55:09.537015 13486 consensus_queue.cc:260] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.536604 13497 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.537763 13497 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:09.537602 13499 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.537962 13499 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:09.538993 13482 ts_tablet_manager.cc:1428] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 06:55:09.538561 13486 ts_tablet_manager.cc:1428] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 06:55:09.540584 13481 ts_tablet_manager.cc:1428] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260807 06:55:09.637784 13499 raft_consensus.cc:482] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:09.638069 13499 raft_consensus.cc:504] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.639633 13499 leader_election.cc:288] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3b1ac98ad6448639ad1abae2057bfad (127.10.191.129:44381), 418af3faf5e34bd59eb3c678004593b9 (127.10.191.130:38593)
I20260807 06:55:09.651226 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.640200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:51923 (local address 127.10.191.130:38593)
0807 06:55:09.640694 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.640701 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.640734 (+ 33us) server_negotiation.cc:407] Connection header received
0807 06:55:09.640976 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.640986 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.641110 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.641199 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:09.642135 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.643858 (+ 1723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.647759 (+ 3901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.649654 (+ 1895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.649827 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.649943 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.650729 (+ 786us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.650887 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340}
I20260807 06:55:09.652472 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.639888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:38593 (local address 127.10.191.131:51923)
0807 06:55:09.640480 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:09.640504 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:09.640728 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:09.641516 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:09.641524 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:09.641575 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:09.641905 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.641922 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.644214 (+ 2292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.644224 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.647470 (+ 3246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.647499 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.650129 (+ 2630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.650136 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.650477 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.650529 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 06:55:09.651714 (+ 1185us) client_negotiation.cc:240] Negotiation successful
0807 06:55:09.651922 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":10767,"threads_started":1}
I20260807 06:55:09.653586 13163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f29f7a00e4864bee9812b749136289d8" candidate_uuid: "cee22496beaa46e68d79876c5c147420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "418af3faf5e34bd59eb3c678004593b9" is_pre_election: true
I20260807 06:55:09.654088 13163 raft_consensus.cc:2454] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cee22496beaa46e68d79876c5c147420 in term 0.
I20260807 06:55:09.654779 13266 leader_election.cc:302] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 418af3faf5e34bd59eb3c678004593b9, cee22496beaa46e68d79876c5c147420; no voters:
I20260807 06:55:09.655400 13499 raft_consensus.cc:2781] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:09.655536 13499 raft_consensus.cc:482] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:09.655637 13499 raft_consensus.cc:3037] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:09.658576 13555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.639898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:44381 (local address 127.10.191.131:53485)
0807 06:55:09.650987 (+ 11089us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:09.651009 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:09.651160 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:09.651776 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:09.651782 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:09.651811 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:09.652250 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.652265 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.653668 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.653676 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.655786 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.655805 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.657657 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.657664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.657860 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.657894 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 06:55:09.657993 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 06:55:09.658150 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10928,"thread_start_us":840,"threads_started":1}
I20260807 06:55:09.658427 13499 raft_consensus.cc:504] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.658614 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.640331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:53485 (local address 127.10.191.129:44381)
0807 06:55:09.650204 (+ 9873us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.650211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.651126 (+ 915us) server_negotiation.cc:407] Connection header received
0807 06:55:09.651310 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.651317 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.651401 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.651515 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:09.652431 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.653508 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.655975 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.657432 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.657625 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.657702 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.658047 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.658208 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9723,"thread_start_us":10043,"threads_started":1}
I20260807 06:55:09.659313 13499 leader_election.cc:288] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [CANDIDATE]: Term 1 election: Requested vote from peers b3b1ac98ad6448639ad1abae2057bfad (127.10.191.129:44381), 418af3faf5e34bd59eb3c678004593b9 (127.10.191.130:38593)
I20260807 06:55:09.659684 12929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f29f7a00e4864bee9812b749136289d8" candidate_uuid: "cee22496beaa46e68d79876c5c147420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b1ac98ad6448639ad1abae2057bfad" is_pre_election: true
I20260807 06:55:09.659987 12929 raft_consensus.cc:2454] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cee22496beaa46e68d79876c5c147420 in term 0.
I20260807 06:55:09.660027 13163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f29f7a00e4864bee9812b749136289d8" candidate_uuid: "cee22496beaa46e68d79876c5c147420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "418af3faf5e34bd59eb3c678004593b9"
I20260807 06:55:09.659945 12928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f29f7a00e4864bee9812b749136289d8" candidate_uuid: "cee22496beaa46e68d79876c5c147420" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3b1ac98ad6448639ad1abae2057bfad"
I20260807 06:55:09.660269 13163 raft_consensus.cc:3037] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:09.660265 12928 raft_consensus.cc:3037] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:09.663839 12928 raft_consensus.cc:2454] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cee22496beaa46e68d79876c5c147420 in term 1.
I20260807 06:55:09.663913 13163 raft_consensus.cc:2454] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cee22496beaa46e68d79876c5c147420 in term 1.
I20260807 06:55:09.664522 13266 leader_election.cc:302] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 418af3faf5e34bd59eb3c678004593b9, cee22496beaa46e68d79876c5c147420; no voters:
I20260807 06:55:09.664897 13499 raft_consensus.cc:2781] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:09.665457 13499 raft_consensus.cc:686] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [term 1 LEADER]: Becoming Leader. State: Replica: cee22496beaa46e68d79876c5c147420, State: Running, Role: LEADER
I20260807 06:55:09.665904 13499 consensus_queue.cc:237] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } }
I20260807 06:55:09.668104 13559 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: TxnStatusTablet state changed. Reason: New leader cee22496beaa46e68d79876c5c147420. Latest consensus state: current_term: 1 leader_uuid: "cee22496beaa46e68d79876c5c147420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.668494 13559 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:55:09.669615 13562 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 06:55:09.669857 13562 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 06:55:09.670244 12670 catalog_manager.cc:5495] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 reported cstate change: term changed from 0 to 1, leader changed from <none> to cee22496beaa46e68d79876c5c147420 (127.10.191.131). New cstate: current_term: 1 leader_uuid: "cee22496beaa46e68d79876c5c147420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } health_report { overall_health: HEALTHY } } }
I20260807 06:55:09.696903 13543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.689059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:34537 (local address 127.0.0.1:55054)
0807 06:55:09.689595 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:09.689621 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:09.689817 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:09.690992 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:09.690997 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:09.691014 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:55:09.691255 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.691270 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.692477 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.692483 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.693761 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.693777 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.694727 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.694733 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.694906 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.695009 (+ 103us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:55:09.696276 (+ 1267us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:55:09.696304 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 06:55:09.696402 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:55:09.696584 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279}
I20260807 06:55:09.696935 13567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.689096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55054 (local address 127.10.191.131:34537)
0807 06:55:09.690598 (+ 1502us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.690603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.690621 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:55:09.690708 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.690711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.690793 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.690962 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:09.691419 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.692276 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.693967 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.694550 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.694687 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.695310 (+ 623us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:09.696152 (+ 842us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:09.696323 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.696434 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.696519 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1327,"thread_start_us":1153,"threads_started":1}
I20260807 06:55:09.702059 12928 raft_consensus.cc:1261] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Refusing update from remote peer cee22496beaa46e68d79876c5c147420: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:09.702448 13163 raft_consensus.cc:1261] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9 [term 1 FOLLOWER]: Refusing update from remote peer cee22496beaa46e68d79876c5c147420: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:09.703088 13559 consensus_queue.cc:1035] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:09.703462 13499 consensus_queue.cc:1035] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420 [LEADER]: Connected to new peer: Peer: permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:09.709823 13497 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: TxnStatusTablet state changed. Reason: New leader cee22496beaa46e68d79876c5c147420. Latest consensus state: current_term: 1 leader_uuid: "cee22496beaa46e68d79876c5c147420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.710165 13497 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:09.713254 13568 mvcc.cc:205] Tried to move back new op lower bound from 7315807066931863552 to 7315807066795786240. Current Snapshot: MvccSnapshot[applied={T|T < 7315807066931863552}]
I20260807 06:55:09.714803 13559 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cee22496beaa46e68d79876c5c147420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.715131 13559 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:55:09.715097 13570 mvcc.cc:205] Tried to move back new op lower bound from 7315807066931863552 to 7315807066795786240. Current Snapshot: MvccSnapshot[applied={T|T < 7315807066931863552}]
I20260807 06:55:09.733355 13497 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cee22496beaa46e68d79876c5c147420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.733667 13497 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P b3b1ac98ad6448639ad1abae2057bfad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:09.737739 13504 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: TxnStatusTablet state changed. Reason: New leader cee22496beaa46e68d79876c5c147420. Latest consensus state: current_term: 1 leader_uuid: "cee22496beaa46e68d79876c5c147420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.738104 13504 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:09.739529 13499 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cee22496beaa46e68d79876c5c147420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.739835 13499 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P cee22496beaa46e68d79876c5c147420: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:55:09.741981 13569 mvcc.cc:205] Tried to move back new op lower bound from 7315807066931863552 to 7315807066795786240. Current Snapshot: MvccSnapshot[applied={T|T < 7315807066931863552}]
I20260807 06:55:09.754803 13504 tablet_replica.cc:439] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cee22496beaa46e68d79876c5c147420" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 } } peers { permanent_uuid: "418af3faf5e34bd59eb3c678004593b9" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 38593 } } peers { permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 } } }
I20260807 06:55:09.755105 13504 tablet_replica.cc:442] T f29f7a00e4864bee9812b749136289d8 P 418af3faf5e34bd59eb3c678004593b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:09.766526 13567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.758456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:45119 (local address 127.10.191.131:34537)
0807 06:55:09.758632 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.758639 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.759237 (+ 598us) server_negotiation.cc:407] Connection header received
0807 06:55:09.759751 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.759757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.759857 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.759952 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:09.760706 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.761960 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.764157 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.764884 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.764984 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.765695 (+ 711us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:09.765837 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:09.765902 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.766125 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.766219 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:55:09.767364 13584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.758336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:34537 (local address 127.10.191.130:45119)
0807 06:55:09.759084 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:09.759107 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:09.759562 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:09.760145 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:09.760150 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:09.760163 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:55:09.760533 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.760545 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.762224 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.762229 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.763964 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.763982 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.765213 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.765219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.765401 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.765490 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:55:09.765989 (+ 499us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:55:09.766000 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 06:55:09.766806 (+ 806us) client_negotiation.cc:240] Negotiation successful
0807 06:55:09.766969 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":317,"threads_started":1}
I20260807 06:55:09.778859 13375 raft_consensus.cc:1261] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Refusing update from remote peer 418af3faf5e34bd59eb3c678004593b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:09.778918 12929 raft_consensus.cc:1261] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Refusing update from remote peer 418af3faf5e34bd59eb3c678004593b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:09.779711 13487 consensus_queue.cc:1035] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3b1ac98ad6448639ad1abae2057bfad" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 44381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:09.780092 13504 consensus_queue.cc:1035] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cee22496beaa46e68d79876c5c147420" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:09.828560 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.821287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:33653 (local address 127.10.191.130:38593)
0807 06:55:09.821509 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.821516 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.821908 (+ 392us) server_negotiation.cc:407] Connection header received
0807 06:55:09.822137 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.822143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.822257 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.822346 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:09.823229 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.824238 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.826468 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.826926 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.827076 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.827622 (+ 546us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:09.827752 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:09.827839 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.827960 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.828052 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 06:55:09.828771 13588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.821192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:38593 (local address 127.10.191.131:33653)
0807 06:55:09.821802 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:09.821819 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:09.821983 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:09.822390 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:09.822395 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:09.822593 (+ 198us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:55:09.823007 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.823021 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.824512 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.824517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.826293 (+ 1776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:09.826313 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.827130 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.827138 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:09.827333 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.827415 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:55:09.827839 (+ 424us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:55:09.827859 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 06:55:09.827940 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 06:55:09.828347 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":269,"threads_started":1}
I20260807 06:55:09.868736 12670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:09.868968 12670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:09.872381 12670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 31a2fa46172a44d6a7353c66e3e17e17: Sending DeleteTablet for 3 replicas of tablet e2db51b0c43f4e738803918fe11e056a
I20260807 06:55:09.873306 13122 tablet_service.cc:1514] Processing DeleteTablet for tablet e2db51b0c43f4e738803918fe11e056a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:09 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:49160
I20260807 06:55:09.873699 13348 tablet_service.cc:1514] Processing DeleteTablet for tablet e2db51b0c43f4e738803918fe11e056a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:09 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:55046
I20260807 06:55:09.873835 12884 tablet_service.cc:1514] Processing DeleteTablet for tablet e2db51b0c43f4e738803918fe11e056a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:09 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:34444
I20260807 06:55:09.882499 13597 tablet_replica.cc:330] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: stopping tablet replica
I20260807 06:55:09.883538 13597 raft_consensus.cc:2229] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:09.884363 13597 raft_consensus.cc:2258] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:09.886791 13594 tablet_replica.cc:330] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: stopping tablet replica
I20260807 06:55:09.887296 13594 raft_consensus.cc:2229] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:09.887669 13597 ts_tablet_manager.cc:1905] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:09.887832 13594 raft_consensus.cc:2258] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:09.888398 13593 tablet_replica.cc:330] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: stopping tablet replica
I20260807 06:55:09.888623 13593 raft_consensus.cc:2229] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:09.889055 13593 raft_consensus.cc:2258] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:09.889467 13594 ts_tablet_manager.cc:1905] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:09.890534 13593 ts_tablet_manager.cc:1905] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:09.897396 13594 ts_tablet_manager.cc:1918] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:55:09.897642 13594 log.cc:1196] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/e2db51b0c43f4e738803918fe11e056a
I20260807 06:55:09.898254 13594 ts_tablet_manager.cc:1939] T e2db51b0c43f4e738803918fe11e056a P cee22496beaa46e68d79876c5c147420: Deleting consensus metadata
I20260807 06:55:09.899709 12652 catalog_manager.cc:4841] TS cee22496beaa46e68d79876c5c147420 (127.10.191.131:34537): tablet e2db51b0c43f4e738803918fe11e056a (table test-table [id=c521d342cac3476986a74969e8e18376]) successfully deleted
I20260807 06:55:09.900262 13593 ts_tablet_manager.cc:1918] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:55:09.900456 13593 log.cc:1196] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/e2db51b0c43f4e738803918fe11e056a
I20260807 06:55:09.900868 13593 ts_tablet_manager.cc:1939] T e2db51b0c43f4e738803918fe11e056a P 418af3faf5e34bd59eb3c678004593b9: Deleting consensus metadata
I20260807 06:55:09.902056 12650 catalog_manager.cc:4841] TS 418af3faf5e34bd59eb3c678004593b9 (127.10.191.130:38593): tablet e2db51b0c43f4e738803918fe11e056a (table test-table [id=c521d342cac3476986a74969e8e18376]) successfully deleted
I20260807 06:55:09.902374 13597 ts_tablet_manager.cc:1918] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:55:09.902518 13597 log.cc:1196] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/e2db51b0c43f4e738803918fe11e056a
I20260807 06:55:09.903010 13597 ts_tablet_manager.cc:1939] T e2db51b0c43f4e738803918fe11e056a P b3b1ac98ad6448639ad1abae2057bfad: Deleting consensus metadata
I20260807 06:55:09.904177 12652 catalog_manager.cc:4841] TS b3b1ac98ad6448639ad1abae2057bfad (127.10.191.129:44381): tablet e2db51b0c43f4e738803918fe11e056a (table test-table [id=c521d342cac3476986a74969e8e18376]) successfully deleted
Aug 07 06:55:09 dist-test-slave-tfpf krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:09.918089 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.892616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34454 (local address 127.10.191.129:44381)
0807 06:55:09.892868 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.892875 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.901705 (+ 8830us) server_negotiation.cc:407] Connection header received
0807 06:55:09.902052 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.902057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.902177 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.902272 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:09.904258 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.905006 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.906451 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.906867 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.907016 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.911679 (+ 4663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:09.911698 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:09.911716 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:09.911768 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:09.914933 (+ 3165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:09.915894 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:09.915921 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:09.915924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:09.916097 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:09.916507 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:09.916514 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:09.916518 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:09.916942 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:09.917292 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.917576 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.917785 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 06:55:09.918967 12991 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34454
I20260807 06:55:09.939455 13542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.922721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36740 (local address 127.10.191.190:43515)
0807 06:55:09.922969 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.922975 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.923235 (+ 260us) server_negotiation.cc:407] Connection header received
0807 06:55:09.923422 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.923426 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.923494 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.923581 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:09.925444 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.926154 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.928085 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.928824 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.928951 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.932301 (+ 3350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:09.932308 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:09.932313 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:09.932365 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:09.936071 (+ 3706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:09.936981 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:09.936987 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:09.936991 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:09.937203 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:09.937732 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:09.937738 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:09.937741 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:09.938162 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:09.938402 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.938823 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.939081 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260807 06:55:09.940112 12670 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36740
I20260807 06:55:09.942162 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 12779
I20260807 06:55:09.964228 13558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:09.943708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34464 (local address 127.10.191.129:44381)
0807 06:55:09.943896 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:09.943901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:09.949692 (+ 5791us) server_negotiation.cc:407] Connection header received
0807 06:55:09.949846 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:09.949854 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:09.949948 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:09.950062 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:09.951574 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.952654 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.954435 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:09.955062 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:09.955189 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:09.958264 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:09.958269 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:09.958272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:09.958309 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:09.961250 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:09.962184 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:09.962188 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:09.962190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:09.962330 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:09.962775 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:09.962778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:09.962780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:09.963162 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:09.963358 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:09.963749 (+ 391us) server_negotiation.cc:299] Negotiation successful
0807 06:55:09.963933 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 06:55:09.964988 12991 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34464
W20260807 06:55:09.965714 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 12779: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 06:55:09.965930 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 12779
I20260807 06:55:10.003731 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 13007
Aug 07 06:55:10 dist-test-slave-tfpf krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:55:10.021377 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:10.004609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49184 (local address 127.10.191.130:38593)
0807 06:55:10.004834 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:10.004841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:10.004866 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:55:10.004944 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:10.004949 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:10.005049 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:10.005209 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:10.006389 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:10.007580 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:10.008859 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:10.009630 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:10.009776 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:10.014449 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:10.014469 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:10.014491 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:10.014549 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:10.018152 (+ 3603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:10.018951 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:10.018960 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:10.018962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:10.019121 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:10.019580 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:10.019585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:10.019590 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:10.019975 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:10.020329 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:10.020647 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 06:55:10.020908 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 06:55:10.022202 13226 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49184
W20260807 06:55:10.022900 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 13007: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 06:55:10.023097 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 13007
I20260807 06:55:10.058390 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 13241
Aug 07 06:55:10 dist-test-slave-tfpf krb5kdc[12608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:55:10.075757 13567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:10.059239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55070 (local address 127.10.191.131:34537)
0807 06:55:10.059451 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:10.059458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:10.059609 (+ 151us) server_negotiation.cc:407] Connection header received
0807 06:55:10.059867 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:10.059872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:10.059998 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:10.060120 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:10.061667 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:10.062648 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:10.063926 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:10.064362 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:10.064507 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:10.069156 (+ 4649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:10.069193 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:10.069212 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:10.069267 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:10.072541 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:10.073381 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:10.073398 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:10.073400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:10.073579 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:10.074006 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:10.074017 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:10.074019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:10.074426 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:10.074801 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:10.075106 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 06:55:10.075365 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 06:55:10.076603 13447 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55070
W20260807 06:55:10.077382 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 13241: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 06:55:10.077554 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 13241
I20260807 06:55:10.111155 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 12623
I20260807 06:55:10.112432 12735 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:10.229581 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 12623
2026-08-07T06:55:10Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5273 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:10 dist-test-slave-tfpf krb5kdc[13608](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:10 dist-test-slave-tfpf krb5kdc[13608](info): set up 2 sockets
Aug 07 06:55:10 dist-test-slave-tfpf krb5kdc[13608](info): commencing operation
krb5kdc: starting...
W20260807 06:55:11.504653 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.002s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:11 dist-test-slave-tfpf krb5kdc[13608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:55:11.746810 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:37775
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:37775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:12.097661 13629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:12.098070 13629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:12.098227 13629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:12.105635 13629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:12.105815 13629 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 06:55:12.105914 13629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:12.106036 13629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:12.106119 13629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:12.106207 13629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:12.116757 13629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:37775
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:37775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:12.118330 13629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:12.119978 13629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:12.132841 13635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:12.132886 13638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:12.132965 13634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:12.133821 13629 server_base.cc:1034] running on GCE node
I20260807 06:55:12.134618 13629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:12.136049 13629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:12.137259 13629 hybrid_clock.cc:648] HybridClock initialized: now 1786085712137164 us; error 66 us; skew 500 ppm
I20260807 06:55:12.137603 13629 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:12 dist-test-slave-tfpf krb5kdc[13608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085712, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:12.141055 13629 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:55:12.142901 13629 webserver.cc:460] Webserver started at http://127.10.191.190:36651/ using document root <none> and password file <none>
I20260807 06:55:12.143692 13629 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:12.143813 13629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:12.144186 13629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:12.147800 13629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "68be8ac70c9a44f884927e6a00f226a9"
format_stamp: "Formatted at 2026-08-07 06:55:12 on dist-test-slave-tfpf"
server_key: "218e4bfa137e097534c21fe39c95ea0c"
server_key_iv: "a039a07b63ef135abc652ffa774202e5"
server_key_version: "encryptionkey@0"
I20260807 06:55:12.148618 13629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "68be8ac70c9a44f884927e6a00f226a9"
format_stamp: "Formatted at 2026-08-07 06:55:12 on dist-test-slave-tfpf"
server_key: "218e4bfa137e097534c21fe39c95ea0c"
server_key_iv: "a039a07b63ef135abc652ffa774202e5"
server_key_version: "encryptionkey@0"
I20260807 06:55:12.154522 13629 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260807 06:55:12.158702 13647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:12.160252 13629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:55:12.160471 13629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "68be8ac70c9a44f884927e6a00f226a9"
format_stamp: "Formatted at 2026-08-07 06:55:12 on dist-test-slave-tfpf"
server_key: "218e4bfa137e097534c21fe39c95ea0c"
server_key_iv: "a039a07b63ef135abc652ffa774202e5"
server_key_version: "encryptionkey@0"
I20260807 06:55:12.160748 13629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:12.175767 13629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:12.180142 13629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:12.180451 13629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:12.203778 13629 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:37775
I20260807 06:55:12.203785 13742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:37775 every 8 connection(s)
I20260807 06:55:12.205353 13629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:12.209558 13743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:12.213655 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 13629
I20260807 06:55:12.213889 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:12.214572 11006 external_mini_cluster.cc:1428] Setting key 0ba461d03954235f1ee835c9b6bfc026
I20260807 06:55:12.222043 13743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9: Bootstrap starting.
I20260807 06:55:12.226137 13743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:12.227542 13743 log.cc:824] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:55:12 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:12.231127 13743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9: No bootstrap required, opened a new log
I20260807 06:55:12.242584 13743 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68be8ac70c9a44f884927e6a00f226a9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37775 } }
I20260807 06:55:12.243285 13743 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:12.243412 13743 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68be8ac70c9a44f884927e6a00f226a9, State: Initialized, Role: FOLLOWER
I20260807 06:55:12.243739 13749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:12.216796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59732 (local address 127.10.191.190:37775)
0807 06:55:12.217748 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:12.217764 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:12.217811 (+ 47us) server_negotiation.cc:407] Connection header received
0807 06:55:12.220099 (+ 2288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:12.220126 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:12.220574 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:12.220916 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:12.222982 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.224385 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.226289 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.227008 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.227179 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:12.232001 (+ 4822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:12.232009 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:12.232040 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:12.232088 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:12.236566 (+ 4478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:12.237690 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:12.237702 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:12.237713 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:12.237965 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:12.238495 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:12.238500 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:12.238505 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:12.239405 (+ 900us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:12.239785 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:12.241189 (+ 1404us) server_negotiation.cc:299] Negotiation successful
0807 06:55:12.241862 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":479,"threads_started":1}
I20260807 06:55:12.244272 13743 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68be8ac70c9a44f884927e6a00f226a9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37775 } }
I20260807 06:55:12.244669 13743 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:12.244839 13743 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:12.245076 13743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:12.254918 13743 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68be8ac70c9a44f884927e6a00f226a9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37775 } }
I20260807 06:55:12.255851 13743 leader_election.cc:302] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68be8ac70c9a44f884927e6a00f226a9; no voters:
I20260807 06:55:12.256735 13743 leader_election.cc:288] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:12.256850 13753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:12.257633 13753 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [term 1 LEADER]: Becoming Leader. State: Replica: 68be8ac70c9a44f884927e6a00f226a9, State: Running, Role: LEADER
I20260807 06:55:12.258246 13753 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68be8ac70c9a44f884927e6a00f226a9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37775 } }
I20260807 06:55:12.259457 13743 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:12.261339 13759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68be8ac70c9a44f884927e6a00f226a9. Latest consensus state: current_term: 1 leader_uuid: "68be8ac70c9a44f884927e6a00f226a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68be8ac70c9a44f884927e6a00f226a9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37775 } } }
I20260807 06:55:12.262671 13759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:12.263083 13754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68be8ac70c9a44f884927e6a00f226a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68be8ac70c9a44f884927e6a00f226a9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37775 } } }
I20260807 06:55:12.263401 13754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:12.269857 13768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:12.275677 13768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:12.287165 13768 catalog_manager.cc:1347] Generated new cluster ID: 41bb712a0969448a96f6a81d5b4e02cc
I20260807 06:55:12.287302 13768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:12.304263 13768 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:12.305769 13768 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:12.318979 13768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9: Generated new TSK 0
I20260807 06:55:12.320030 13768 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:55:12.386891 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37775
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:12.753719 13799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:12.754055 13799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:12.754235 13799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:12.761690 13799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:12.761834 13799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:12.761996 13799 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 06:55:12.762074 13799 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:55:12.762176 13799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:12.772693 13799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.191.190:37775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:12.774187 13799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:12.775617 13799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:12.789664 13808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:12.789628 13811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:12.790218 13814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:12.790742 13799 server_base.cc:1034] running on GCE node
I20260807 06:55:12.791411 13799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:12.792517 13799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:12.793742 13799 hybrid_clock.cc:648] HybridClock initialized: now 1786085712793679 us; error 55 us; skew 500 ppm
I20260807 06:55:12.794039 13799 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:12 dist-test-slave-tfpf krb5kdc[13608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085712, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:12.797343 13799 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:55:12.798951 13799 webserver.cc:460] Webserver started at http://127.10.191.129:40969/ using document root <none> and password file <none>
I20260807 06:55:12.799721 13799 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:12.799866 13799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:12.800238 13799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:12.803393 13799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "40b22220931c462ba00fb2a8e0ecb87c"
format_stamp: "Formatted at 2026-08-07 06:55:12 on dist-test-slave-tfpf"
server_key: "6ec91e0021271b6abf0712ccf3f8f1d5"
server_key_iv: "a96b9354d95a6753210b774544a5b135"
server_key_version: "encryptionkey@0"
I20260807 06:55:12.804157 13799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "40b22220931c462ba00fb2a8e0ecb87c"
format_stamp: "Formatted at 2026-08-07 06:55:12 on dist-test-slave-tfpf"
server_key: "6ec91e0021271b6abf0712ccf3f8f1d5"
server_key_iv: "a96b9354d95a6753210b774544a5b135"
server_key_version: "encryptionkey@0"
I20260807 06:55:12.809561 13799 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 06:55:12.813323 13824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:12.814688 13799 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:55:12.814867 13799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "40b22220931c462ba00fb2a8e0ecb87c"
format_stamp: "Formatted at 2026-08-07 06:55:12 on dist-test-slave-tfpf"
server_key: "6ec91e0021271b6abf0712ccf3f8f1d5"
server_key_iv: "a96b9354d95a6753210b774544a5b135"
server_key_version: "encryptionkey@0"
I20260807 06:55:12.815111 13799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:12.834029 13799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:12.838460 13799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:12.838774 13799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:12.841712 13799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:12.841869 13799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:12.842007 13799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:12.842101 13799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:55:12 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085712, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:12.871132 13836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:12.842600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:51305 (local address 127.10.191.190:37775)
0807 06:55:12.843198 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:12.843204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:12.844510 (+ 1306us) server_negotiation.cc:407] Connection header received
0807 06:55:12.846763 (+ 2253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:12.846769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:12.846878 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:12.847024 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:12.849823 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.850911 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.854688 (+ 3777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.855450 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.855604 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:12.862282 (+ 6678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:12.862288 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:12.862291 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:12.862332 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:12.866307 (+ 3975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:12.867487 (+ 1180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:12.867494 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:12.867498 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:12.867641 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:12.868252 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:12.868261 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:12.868266 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:12.868685 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:12.868913 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:12.870244 (+ 1331us) server_negotiation.cc:299] Negotiation successful
0807 06:55:12.870575 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":311,"threads_started":1}
I20260807 06:55:12.872037 13838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:12.843306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37775 (local address 127.10.191.129:51305)
0807 06:55:12.844290 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:12.844352 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:12.846375 (+ 2023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:12.847431 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:12.847439 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:12.848474 (+ 1035us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:12.849600 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:12.849625 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.851170 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.851180 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:12.854379 (+ 3199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:12.854409 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.856139 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.856154 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:12.856628 (+ 474us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:12.857679 (+ 1051us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:12.857727 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:12.861934 (+ 4207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:12.866517 (+ 4583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:12.866528 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:12.866554 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:12.867328 (+ 774us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:12.867770 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:12.867779 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:12.867783 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:12.868041 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:12.868883 (+ 842us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:12.868892 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:12.869646 (+ 754us) client_negotiation.cc:769] Sending connection context
0807 06:55:12.870083 (+ 437us) client_negotiation.cc:240] Negotiation successful
0807 06:55:12.870773 (+ 690us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":414,"threads_started":1}
I20260807 06:55:12.894657 13836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:12.878706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:39279 (local address 127.10.191.190:37775)
0807 06:55:12.878953 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:12.878961 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:12.879481 (+ 520us) server_negotiation.cc:407] Connection header received
0807 06:55:12.879741 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:12.879746 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:12.879817 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:12.879925 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:12.880926 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.881841 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.884120 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.884829 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.884976 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:12.888023 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:12.888031 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:12.888038 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:12.888086 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:12.891649 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:12.892375 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:12.892381 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:12.892384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:12.892527 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:12.892916 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:12.892921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:12.892924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:12.893361 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:12.893611 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:12.894034 (+ 423us) server_negotiation.cc:299] Negotiation successful
0807 06:55:12.894284 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 06:55:12.894945 13947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:12.878664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37775 (local address 127.10.191.129:39279)
0807 06:55:12.879342 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:12.879365 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:12.879568 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:12.879962 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:12.879966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:12.880451 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:12.880762 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:12.880773 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.881991 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.881995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:12.883964 (+ 1969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:12.883979 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:12.885026 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:12.885036 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:12.885255 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:12.886127 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:12.886154 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:12.887752 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:12.891813 (+ 4061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:12.891819 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:12.891823 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:12.892245 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:12.892651 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:12.892657 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:12.892660 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:12.892801 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:12.893548 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:12.893553 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:12.893756 (+ 203us) client_negotiation.cc:769] Sending connection context
0807 06:55:12.893923 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 06:55:12.894403 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":356,"threads_started":1}
I20260807 06:55:12.901463 13799 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:33147
I20260807 06:55:12.901518 14013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:33147 every 8 connection(s)
I20260807 06:55:12.902869 13799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:12.904804 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 13799
I20260807 06:55:12.905087 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:12.905838 11006 external_mini_cluster.cc:1428] Setting key 44e3342a0b0d3140952d38e6d9d2dbff
I20260807 06:55:12.905414 14014 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37775
I20260807 06:55:12.906693 14014 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:12.907593 14014 heartbeater.cc:511] Master 127.10.191.190:37775 requested a full tablet report, sending...
I20260807 06:55:12.909868 13673 ts_manager.cc:194] Registered new tserver with Master: 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129:33147)
I20260807 06:55:12.911387 13673 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:51305
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:55:12.958415 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37775
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:13.319989 14018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:13.320319 14018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:13.320431 14018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:13.327744 14018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:13.327895 14018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:13.327984 14018 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 06:55:13.328044 14018 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:55:13.328112 14018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:13.338269 14018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.191.190:37775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:13.339636 14018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:13.340988 14018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:13.354741 14027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:13.354790 14030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:13.354945 14032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:13.356060 14018 server_base.cc:1034] running on GCE node
I20260807 06:55:13.356864 14018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:13.357956 14018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:13.359201 14018 hybrid_clock.cc:648] HybridClock initialized: now 1786085713359114 us; error 66 us; skew 500 ppm
I20260807 06:55:13.359591 14018 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:13 dist-test-slave-tfpf krb5kdc[13608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085713, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:13.367589 14018 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:55:13.369536 14018 webserver.cc:460] Webserver started at http://127.10.191.130:39409/ using document root <none> and password file <none>
I20260807 06:55:13.370347 14018 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:13.370513 14018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:13.370893 14018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:13.374162 14018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e"
format_stamp: "Formatted at 2026-08-07 06:55:13 on dist-test-slave-tfpf"
server_key: "76cd34038a7f691f985dcf7fca1660b2"
server_key_iv: "ffdb34aff1e403060b317c5be08663fc"
server_key_version: "encryptionkey@0"
I20260807 06:55:13.375358 14018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e"
format_stamp: "Formatted at 2026-08-07 06:55:13 on dist-test-slave-tfpf"
server_key: "76cd34038a7f691f985dcf7fca1660b2"
server_key_iv: "ffdb34aff1e403060b317c5be08663fc"
server_key_version: "encryptionkey@0"
I20260807 06:55:13.381604 14018 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260807 06:55:13.385576 14042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:13.387033 14018 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:55:13.387300 14018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e"
format_stamp: "Formatted at 2026-08-07 06:55:13 on dist-test-slave-tfpf"
server_key: "76cd34038a7f691f985dcf7fca1660b2"
server_key_iv: "ffdb34aff1e403060b317c5be08663fc"
server_key_version: "encryptionkey@0"
I20260807 06:55:13.387584 14018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:13.416347 14018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:13.421160 14018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:13.421505 14018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:13.424407 14018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:13.424551 14018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:13.424703 14018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:13.424820 14018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:55:13 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085713, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:13.449331 14057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:13.424805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:60685 (local address 127.10.191.190:37775)
0807 06:55:13.425821 (+ 1016us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:13.425829 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:13.426808 (+ 979us) server_negotiation.cc:407] Connection header received
0807 06:55:13.428925 (+ 2117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:13.428933 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:13.429051 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:13.429211 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:13.431622 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:13.432701 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:13.435609 (+ 2908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:13.436040 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:13.436188 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:13.440969 (+ 4781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:13.440975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:13.440978 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:13.441015 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:13.444619 (+ 3604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:13.445858 (+ 1239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:13.445867 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:13.445871 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:13.446040 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:13.446680 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:13.446689 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:13.446695 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:13.447178 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:13.447383 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:13.448379 (+ 996us) server_negotiation.cc:299] Negotiation successful
0807 06:55:13.448735 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":880,"thread_start_us":748,"threads_started":1}
I20260807 06:55:13.450070 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:13.425635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37775 (local address 127.10.191.130:60685)
0807 06:55:13.426610 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:13.426657 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:13.428635 (+ 1978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:13.429542 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:13.429553 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:13.430421 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:13.431424 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:13.431445 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:13.432884 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:13.432900 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:13.435469 (+ 2569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:13.435486 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:13.436291 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:13.436298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:13.436537 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:13.437423 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:13.437461 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:13.440694 (+ 3233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:13.444797 (+ 4103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:13.444810 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:13.444844 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:13.445645 (+ 801us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:13.446169 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:13.446173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:13.446177 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:13.446483 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:13.447321 (+ 838us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:13.447336 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:13.447880 (+ 544us) client_negotiation.cc:769] Sending connection context
0807 06:55:13.448168 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 06:55:13.448580 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":375,"threads_started":1}
I20260807 06:55:13.471989 14057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:13.456305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:54145 (local address 127.10.191.190:37775)
0807 06:55:13.456515 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:13.456519 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:13.457475 (+ 956us) server_negotiation.cc:407] Connection header received
0807 06:55:13.457692 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:13.457701 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:13.457821 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:13.457975 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:13.458984 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:13.460404 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:13.462479 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:13.462895 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:13.463027 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:13.465171 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:13.465178 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:13.465183 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:13.465239 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:13.468870 (+ 3631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:13.469929 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:13.469937 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:13.469940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:13.470087 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:13.470476 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:13.470481 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:13.470484 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:13.470851 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:13.471007 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:13.471422 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 06:55:13.471655 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:55:13.472056 14145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:13.456430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37775 (local address 127.10.191.130:54145)
0807 06:55:13.457324 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:13.457349 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:13.457529 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:13.457993 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:13.457996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:13.458530 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:13.458829 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:13.458839 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:13.460571 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:13.460579 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:13.462324 (+ 1745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:13.462338 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:13.463100 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:13.463108 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:13.463279 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:13.463944 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:13.463960 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:13.464901 (+ 941us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:13.469098 (+ 4197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:13.469106 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:13.469110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:13.469771 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:13.470206 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:13.470212 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:13.470215 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:13.470352 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:13.470971 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:13.470975 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:13.471164 (+ 189us) client_negotiation.cc:769] Sending connection context
0807 06:55:13.471300 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 06:55:13.471631 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":420,"threads_started":1}
I20260807 06:55:13.486434 14018 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:42221
I20260807 06:55:13.486479 14233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:42221 every 8 connection(s)
I20260807 06:55:13.487922 14018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:13.489035 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 14018
I20260807 06:55:13.489279 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:13.489799 11006 external_mini_cluster.cc:1428] Setting key 5ce71e29a0554335b277e555e03c4a98
I20260807 06:55:13.490629 14234 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37775
I20260807 06:55:13.490919 14234 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:13.491855 14234 heartbeater.cc:511] Master 127.10.191.190:37775 requested a full tablet report, sending...
I20260807 06:55:13.493639 13673 ts_manager.cc:194] Registered new tserver with Master: 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221)
I20260807 06:55:13.494519 13673 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:60685
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:55:13.542392 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37775
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:13.897833 14240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:13.898159 14240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:13.898341 14240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:13.905822 14240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:13.905984 14240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:13.906188 14240 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 06:55:13.906284 14240 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:55:13.906412 14240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:13.914459 14014 heartbeater.cc:503] Master 127.10.191.190:37775 was elected leader, sending a full tablet report...
I20260807 06:55:13.916890 14240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.191.190:37775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:13.918351 14240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:13.919804 14240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:13.933702 14248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:13.933673 14250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:13.934158 14246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:13.934906 14240 server_base.cc:1034] running on GCE node
I20260807 06:55:13.935581 14240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:13.936650 14240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:13.937880 14240 hybrid_clock.cc:648] HybridClock initialized: now 1786085713937832 us; error 35 us; skew 500 ppm
I20260807 06:55:13.938268 14240 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:13 dist-test-slave-tfpf krb5kdc[13608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085713, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:13.941625 14240 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:55:13.943387 14240 webserver.cc:460] Webserver started at http://127.10.191.131:36213/ using document root <none> and password file <none>
I20260807 06:55:13.944197 14240 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:13.944360 14240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:13.944722 14240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:13.948199 14240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "6c73622804bc4ace9df1025abe5dad95"
format_stamp: "Formatted at 2026-08-07 06:55:13 on dist-test-slave-tfpf"
server_key: "d5af441d234638e5858dca1fd75b59b5"
server_key_iv: "5cbff0b42c8faf7730ff4ee5d159d4cc"
server_key_version: "encryptionkey@0"
I20260807 06:55:13.949007 14240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "6c73622804bc4ace9df1025abe5dad95"
format_stamp: "Formatted at 2026-08-07 06:55:13 on dist-test-slave-tfpf"
server_key: "d5af441d234638e5858dca1fd75b59b5"
server_key_iv: "5cbff0b42c8faf7730ff4ee5d159d4cc"
server_key_version: "encryptionkey@0"
I20260807 06:55:13.954912 14240 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 06:55:13.958839 14258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:13.960486 14240 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260807 06:55:13.960721 14240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "6c73622804bc4ace9df1025abe5dad95"
format_stamp: "Formatted at 2026-08-07 06:55:13 on dist-test-slave-tfpf"
server_key: "d5af441d234638e5858dca1fd75b59b5"
server_key_iv: "5cbff0b42c8faf7730ff4ee5d159d4cc"
server_key_version: "encryptionkey@0"
I20260807 06:55:13.961002 14240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:13.989634 14240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:13.994371 14240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:13.994657 14240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:13.997581 14240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:13.997689 14240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:13.997835 14240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:13.997951 14240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:55:14 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085713, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:14.023698 14269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:13.998150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:54877 (local address 127.10.191.190:37775)
0807 06:55:13.998839 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:13.998846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.000003 (+ 1157us) server_negotiation.cc:407] Connection header received
0807 06:55:14.002524 (+ 2521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.002531 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.002648 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.002740 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:14.005497 (+ 2757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.006452 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.009913 (+ 3461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.010478 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.010655 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.015907 (+ 5252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:14.015913 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:14.015916 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:14.015954 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:14.019407 (+ 3453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:14.020748 (+ 1341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:14.020752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:14.020755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:14.020906 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:14.021550 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:14.021554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:14.021556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:14.021842 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:14.021988 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.023197 (+ 1209us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.023382 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":427,"threads_started":1}
I20260807 06:55:14.026299 14270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:13.998840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37775 (local address 127.10.191.131:54877)
0807 06:55:13.999815 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:13.999863 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.002140 (+ 2277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.003353 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.003370 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.004198 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:14.005259 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.005303 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.006687 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.006693 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.009660 (+ 2967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.009706 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.010850 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.010858 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.011282 (+ 424us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.012427 (+ 1145us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:14.012474 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:14.015620 (+ 3146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:14.019592 (+ 3972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:14.019606 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:14.019636 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:14.020564 (+ 928us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:14.021033 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:14.021041 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:14.021047 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:14.021415 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:14.022011 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:14.022024 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:14.022691 (+ 667us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.023094 (+ 403us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.024026 (+ 932us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":407,"threads_started":1}
I20260807 06:55:14.050959 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.033495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37775 (local address 127.10.191.131:45849)
0807 06:55:14.034639 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:14.034656 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.034845 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.035322 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.035330 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.036348 (+ 1018us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:14.036990 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.037010 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.038455 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.038466 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.040345 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.040368 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.041525 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.041531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.041663 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.042404 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:14.042433 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:14.043710 (+ 1277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:14.048022 (+ 4312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:14.048027 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:14.048031 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:14.048465 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:14.048989 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:14.048994 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:14.048998 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:14.049191 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:14.049748 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:14.049755 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:14.049973 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.050152 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.050581 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":999,"thread_start_us":860,"threads_started":1}
I20260807 06:55:14.051191 14240 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:40691
I20260807 06:55:14.051434 14437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:40691 every 8 connection(s)
I20260807 06:55:14.052044 14269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.033786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:45849 (local address 127.10.191.190:37775)
0807 06:55:14.034051 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.034062 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.034761 (+ 699us) server_negotiation.cc:407] Connection header received
0807 06:55:14.035001 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.035009 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.035127 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.035244 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:14.037255 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.038219 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.040532 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.041324 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.041485 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.043959 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:14.043969 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:14.043977 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:14.044036 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:14.047863 (+ 3827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:14.048614 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:14.048622 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:14.048628 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:14.048827 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:14.049319 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:14.049323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:14.049325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:14.049615 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:14.049789 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.051471 (+ 1682us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.051751 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:55:14.052897 14240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:14.055266 14440 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37775
I20260807 06:55:14.055533 14440 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:14.056429 14440 heartbeater.cc:511] Master 127.10.191.190:37775 requested a full tablet report, sending...
I20260807 06:55:14.057865 13673 ts_manager.cc:194] Registered new tserver with Master: 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691)
I20260807 06:55:14.058615 13673 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:54877
I20260807 06:55:14.059582 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 14240
I20260807 06:55:14.059775 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:14.060252 11006 external_mini_cluster.cc:1428] Setting key ff856e37096c12cfafa7e035fd71739f
I20260807 06:55:14.063349 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:55:14 dist-test-slave-tfpf krb5kdc[13608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:55:14 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:14.123914 14269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.109385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59738 (local address 127.10.191.190:37775)
0807 06:55:14.109611 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.109615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.110071 (+ 456us) server_negotiation.cc:407] Connection header received
0807 06:55:14.110268 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.110272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.110341 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.110444 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:14.112062 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.112784 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.114027 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.114445 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.114545 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.118537 (+ 3992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:14.118542 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:14.118545 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:14.118586 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:14.121411 (+ 2825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:14.122170 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:14.122174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:14.122176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:14.122313 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:14.122647 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:14.122650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:14.122652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:14.122948 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:14.123167 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.123413 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.123584 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:55:14.128252 13673 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59738:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:14.135581 13673 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:14.159178 14466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.149454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36610 (local address 127.10.191.130:42221)
0807 06:55:14.150482 (+ 1028us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.150492 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.150522 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:55:14.150637 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.150647 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.150935 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.151997 (+ 1062us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:14.152241 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.153753 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.156857 (+ 3104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.157981 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.158186 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.158377 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.158695 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.158882 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":857,"thread_start_us":776,"threads_started":1}
I20260807 06:55:14.159360 14464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.148696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:42221 (local address 127.0.0.1:36610)
0807 06:55:14.149512 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:14.149565 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.149780 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.151199 (+ 1419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.151207 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.151247 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:14.151751 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.151767 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.153920 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.153925 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.156634 (+ 2709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.156657 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.158216 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.158223 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.158424 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.158478 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.158630 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.158877 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":131,"thread_start_us":390,"threads_started":1}
I20260807 06:55:14.159832 14465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.148758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:40691 (local address 127.0.0.1:34664)
0807 06:55:14.150403 (+ 1645us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:14.150422 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.151005 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.152354 (+ 1349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.152361 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.152405 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:14.152783 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.152794 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.154717 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.154724 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.156978 (+ 2254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.156993 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.158923 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.158929 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.159099 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.159130 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.159214 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.159367 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1112,"mutex_wait_us":91,"thread_start_us":1214,"threads_started":1}
I20260807 06:55:14.161134 14467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.149954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34664 (local address 127.10.191.131:40691)
0807 06:55:14.151047 (+ 1093us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.151057 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.151115 (+ 58us) server_negotiation.cc:407] Connection header received
0807 06:55:14.151221 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.151227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.151534 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.152972 (+ 1438us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:14.153325 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.154556 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.157192 (+ 2636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.158697 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.160304 (+ 1607us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.160489 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.160573 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.160757 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":920,"thread_start_us":751,"threads_started":1}
I20260807 06:55:14.161325 14471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.150007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:33147 (local address 127.0.0.1:50002)
0807 06:55:14.152156 (+ 2149us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:14.152174 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.152372 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.153271 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.153276 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.153296 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:14.153596 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.153604 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.155506 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.155511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.157766 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.157781 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.160354 (+ 2573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.160361 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.160537 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.160572 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.160714 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.160850 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1963,"mutex_wait_us":30,"thread_start_us":1824,"threads_started":1}
I20260807 06:55:14.162010 14469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.150548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50002 (local address 127.10.191.129:33147)
0807 06:55:14.151586 (+ 1038us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.151597 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.152270 (+ 673us) server_negotiation.cc:407] Connection header received
0807 06:55:14.152653 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.152661 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.152875 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.153007 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:14.153778 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.155321 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.157964 (+ 2643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.159860 (+ 1896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.160296 (+ 436us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.160470 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.161552 (+ 1082us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.161732 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":805,"thread_start_us":651,"threads_started":1}
I20260807 06:55:14.164227 14119 tablet_service.cc:1467] Processing CreateTablet for tablet 39f8efb9b2c84179865a6a944c17f862 (DEFAULT_TABLE table=test-table [id=c795e9794b03497a92c8012820f50aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:14.164784 14323 tablet_service.cc:1467] Processing CreateTablet for tablet 39f8efb9b2c84179865a6a944c17f862 (DEFAULT_TABLE table=test-table [id=c795e9794b03497a92c8012820f50aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:14.165828 14119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f8efb9b2c84179865a6a944c17f862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:14.165768 13896 tablet_service.cc:1467] Processing CreateTablet for tablet 39f8efb9b2c84179865a6a944c17f862 (DEFAULT_TABLE table=test-table [id=c795e9794b03497a92c8012820f50aac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:14.166378 14323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f8efb9b2c84179865a6a944c17f862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:14.167142 13896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39f8efb9b2c84179865a6a944c17f862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:14.178776 14473 tablet_bootstrap.cc:492] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Bootstrap starting.
I20260807 06:55:14.181655 14474 tablet_bootstrap.cc:492] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: Bootstrap starting.
I20260807 06:55:14.183380 14476 tablet_bootstrap.cc:492] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: Bootstrap starting.
I20260807 06:55:14.184016 14473 tablet_bootstrap.cc:654] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:14.185904 14474 tablet_bootstrap.cc:654] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:14.186396 14476 tablet_bootstrap.cc:654] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:14.186777 14473 log.cc:824] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:14.187618 14474 log.cc:824] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:14.187655 14476 log.cc:824] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:14.190604 14473 tablet_bootstrap.cc:492] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: No bootstrap required, opened a new log
I20260807 06:55:14.191000 14473 ts_tablet_manager.cc:1397] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260807 06:55:14.195894 14476 tablet_bootstrap.cc:492] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: No bootstrap required, opened a new log
I20260807 06:55:14.196138 14474 tablet_bootstrap.cc:492] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: No bootstrap required, opened a new log
I20260807 06:55:14.196256 14476 ts_tablet_manager.cc:1397] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260807 06:55:14.196429 14474 ts_tablet_manager.cc:1397] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.005s
I20260807 06:55:14.202883 14473 raft_consensus.cc:348] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } }
I20260807 06:55:14.203542 14473 raft_consensus.cc:374] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:14.203649 14473 raft_consensus.cc:729] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eeb1bf38cc044959c8ebb9fccc2a13e, State: Initialized, Role: FOLLOWER
I20260807 06:55:14.204532 14473 consensus_queue.cc:260] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } }
I20260807 06:55:14.204898 14476 raft_consensus.cc:348] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } }
I20260807 06:55:14.205396 14476 raft_consensus.cc:374] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:14.205485 14476 raft_consensus.cc:729] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40b22220931c462ba00fb2a8e0ecb87c, State: Initialized, Role: FOLLOWER
I20260807 06:55:14.206207 14476 consensus_queue.cc:260] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } }
I20260807 06:55:14.209529 14474 raft_consensus.cc:348] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } }
I20260807 06:55:14.210155 14474 raft_consensus.cc:374] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:14.210281 14474 raft_consensus.cc:729] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73622804bc4ace9df1025abe5dad95, State: Initialized, Role: FOLLOWER
I20260807 06:55:14.211195 14474 consensus_queue.cc:260] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } }
I20260807 06:55:14.213155 14473 ts_tablet_manager.cc:1428] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent starting tablet: real 0.022s user 0.012s sys 0.009s
I20260807 06:55:14.213593 14234 heartbeater.cc:503] Master 127.10.191.190:37775 was elected leader, sending a full tablet report...
I20260807 06:55:14.214265 14476 ts_tablet_manager.cc:1428] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: Time spent starting tablet: real 0.018s user 0.018s sys 0.001s
I20260807 06:55:14.216995 14474 ts_tablet_manager.cc:1428] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: Time spent starting tablet: real 0.020s user 0.009s sys 0.009s
I20260807 06:55:14.217525 14440 heartbeater.cc:503] Master 127.10.191.190:37775 was elected leader, sending a full tablet report...
W20260807 06:55:14.240720 14235 tablet.cc:2369] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:55:14.304941 14445 tablet.cc:2369] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:55:14.405867 14015 tablet.cc:2369] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:55:14.418210 14484 raft_consensus.cc:482] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:14.418529 14484 raft_consensus.cc:504] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } }
I20260807 06:55:14.420559 14484 leader_election.cc:288] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691), 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221)
I20260807 06:55:14.427490 14467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.421049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:41657 (local address 127.10.191.131:40691)
0807 06:55:14.421310 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.421316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.422056 (+ 740us) server_negotiation.cc:407] Connection header received
0807 06:55:14.422285 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.422291 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.422368 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.422433 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:14.423046 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.423744 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.425751 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.426517 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.426723 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.426809 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.427091 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.427221 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 06:55:14.427542 14466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.421186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:38633 (local address 127.10.191.130:42221)
0807 06:55:14.421410 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.421414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.422174 (+ 760us) server_negotiation.cc:407] Connection header received
0807 06:55:14.422346 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.422350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.422431 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.422528 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:14.423173 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.423879 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.425728 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.426512 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.426702 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.426797 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.427146 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.427285 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 06:55:14.427639 14486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.420841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:40691 (local address 127.10.191.129:41657)
0807 06:55:14.421916 (+ 1075us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:14.421937 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.422106 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.422482 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.422488 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.422516 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:14.422892 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.422905 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.423880 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.423885 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.425563 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.425576 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.426770 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.426777 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.426921 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.426946 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.427024 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.427177 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"mutex_wait_us":2,"thread_start_us":752,"threads_started":1}
I20260807 06:55:14.427665 14487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.421186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:42221 (local address 127.10.191.129:38633)
0807 06:55:14.422038 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:14.422060 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.422213 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.422576 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.422581 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.422621 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:14.423007 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.423020 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.424014 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.424018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.425538 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.425556 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.426822 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.426831 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.426958 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.426980 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.427093 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.427219 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":4,"thread_start_us":589,"threads_started":1}
I20260807 06:55:14.428934 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f8efb9b2c84179865a6a944c17f862" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" is_pre_election: true
I20260807 06:55:14.428934 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f8efb9b2c84179865a6a944c17f862" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95" is_pre_election: true
I20260807 06:55:14.429702 14159 raft_consensus.cc:2454] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 0.
I20260807 06:55:14.429695 14350 raft_consensus.cc:2454] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 0.
I20260807 06:55:14.430505 13828 leader_election.cc:302] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 6c73622804bc4ace9df1025abe5dad95; no voters:
I20260807 06:55:14.431042 14484 raft_consensus.cc:2781] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:14.431172 14484 raft_consensus.cc:482] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:14.431324 14484 raft_consensus.cc:3037] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:14.433723 14484 raft_consensus.cc:504] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } }
I20260807 06:55:14.434484 14484 leader_election.cc:288] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 election: Requested vote from peers 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691), 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221)
I20260807 06:55:14.434969 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f8efb9b2c84179865a6a944c17f862" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95"
I20260807 06:55:14.435065 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f8efb9b2c84179865a6a944c17f862" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e"
I20260807 06:55:14.435184 14350 raft_consensus.cc:3037] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:14.435344 14159 raft_consensus.cc:3037] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:14.437723 14350 raft_consensus.cc:2454] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 1.
I20260807 06:55:14.437913 14159 raft_consensus.cc:2454] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 1.
I20260807 06:55:14.438256 13828 leader_election.cc:302] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 6c73622804bc4ace9df1025abe5dad95; no voters:
I20260807 06:55:14.438587 14484 raft_consensus.cc:2781] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:14.439101 14484 raft_consensus.cc:686] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 LEADER]: Becoming Leader. State: Replica: 40b22220931c462ba00fb2a8e0ecb87c, State: Running, Role: LEADER
I20260807 06:55:14.439637 14484 consensus_queue.cc:237] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } }
I20260807 06:55:14.444674 13670 catalog_manager.cc:5495] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c reported cstate change: term changed from 0 to 1, leader changed from <none> to 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129). New cstate: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } health_report { overall_health: HEALTHY } } }
Aug 07 06:55:14 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085712, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:14.558324 14269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.544113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59754 (local address 127.10.191.190:37775)
0807 06:55:14.544336 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.544347 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.544917 (+ 570us) server_negotiation.cc:407] Connection header received
0807 06:55:14.545091 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.545095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.545160 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.545244 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:14.546457 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.547209 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.548492 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.548932 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.549044 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.552697 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:14.552701 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:14.552705 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:14.552740 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:14.555384 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:14.556037 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:14.556040 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:14.556042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:14.556191 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:14.556632 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:14.556638 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:14.556641 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:14.556946 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:14.557135 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.557554 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.557950 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":152,"server-negotiator.queue_time_us":82}
I20260807 06:55:14.558349 14502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.544159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37775 (local address 127.0.0.1:59754)
0807 06:55:14.544802 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:14.544819 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.544959 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.545305 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.545308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.546043 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:14.546315 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.546324 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.547331 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.547335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.548350 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.548363 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.549167 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.549172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.549282 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.549960 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:14.549979 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:14.552513 (+ 2534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:14.555512 (+ 2999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:14.555524 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:14.555530 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:14.555937 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:14.556301 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:14.556305 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:14.556308 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:14.556523 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:14.557114 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:14.557122 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:14.557298 (+ 176us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.557465 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.557798 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":348,"threads_started":1}
I20260807 06:55:14.563944 13670 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:59754:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 06:55:14.565289 13670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:14.572412 13896 tablet_service.cc:1467] Processing CreateTablet for tablet e87bda40a8af44ec85793c0a5d39189d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d1629697e734402af0c5adc1ff1ada3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:55:14.572443 14119 tablet_service.cc:1467] Processing CreateTablet for tablet e87bda40a8af44ec85793c0a5d39189d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d1629697e734402af0c5adc1ff1ada3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:55:14.572687 14323 tablet_service.cc:1467] Processing CreateTablet for tablet e87bda40a8af44ec85793c0a5d39189d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d1629697e734402af0c5adc1ff1ada3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:55:14.573370 13896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e87bda40a8af44ec85793c0a5d39189d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:14.573436 14119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e87bda40a8af44ec85793c0a5d39189d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:14.573436 14323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e87bda40a8af44ec85793c0a5d39189d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:14.579176 14476 tablet_bootstrap.cc:492] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: Bootstrap starting.
I20260807 06:55:14.580559 14474 tablet_bootstrap.cc:492] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: Bootstrap starting.
I20260807 06:55:14.581419 14473 tablet_bootstrap.cc:492] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: Bootstrap starting.
I20260807 06:55:14.581739 14476 tablet_bootstrap.cc:654] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:14.582361 14474 tablet_bootstrap.cc:654] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:14.583140 14473 tablet_bootstrap.cc:654] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:14.587639 14474 tablet_bootstrap.cc:492] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: No bootstrap required, opened a new log
I20260807 06:55:14.587818 14474 ts_tablet_manager.cc:1397] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260807 06:55:14.587998 14473 tablet_bootstrap.cc:492] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: No bootstrap required, opened a new log
I20260807 06:55:14.588182 14473 ts_tablet_manager.cc:1397] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260807 06:55:14.588580 14474 raft_consensus.cc:348] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:14.588797 14474 raft_consensus.cc:374] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:14.588858 14474 raft_consensus.cc:729] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73622804bc4ace9df1025abe5dad95, State: Initialized, Role: FOLLOWER
I20260807 06:55:14.588845 14473 raft_consensus.cc:348] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:14.589031 14473 raft_consensus.cc:374] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:14.589152 14473 raft_consensus.cc:729] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eeb1bf38cc044959c8ebb9fccc2a13e, State: Initialized, Role: FOLLOWER
I20260807 06:55:14.589118 14474 consensus_queue.cc:260] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:14.589378 14473 consensus_queue.cc:260] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:14.589783 14474 ts_tablet_manager.cc:1428] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260807 06:55:14.589674 14485 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.590006 14473 ts_tablet_manager.cc:1428] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:55:14.590042 14485 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:14.590410 14483 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.590777 14483 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:14.592336 14476 tablet_bootstrap.cc:492] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: No bootstrap required, opened a new log
I20260807 06:55:14.592718 14476 ts_tablet_manager.cc:1397] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20260807 06:55:14.593622 14476 raft_consensus.cc:348] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:14.593842 14476 raft_consensus.cc:374] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:14.593937 14476 raft_consensus.cc:729] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40b22220931c462ba00fb2a8e0ecb87c, State: Initialized, Role: FOLLOWER
I20260807 06:55:14.594203 14476 consensus_queue.cc:260] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:14.594607 14484 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.594846 14476 ts_tablet_manager.cc:1428] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 06:55:14.595021 14484 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:14.723086 14484 raft_consensus.cc:482] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:14.723384 14484 raft_consensus.cc:504] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:14.724203 14484 leader_election.cc:288] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221), 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691)
I20260807 06:55:14.724773 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87bda40a8af44ec85793c0a5d39189d" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" is_pre_election: true
I20260807 06:55:14.724814 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87bda40a8af44ec85793c0a5d39189d" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95" is_pre_election: true
I20260807 06:55:14.725047 14159 raft_consensus.cc:2454] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 0.
I20260807 06:55:14.725113 14350 raft_consensus.cc:2454] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 0.
I20260807 06:55:14.725550 13826 leader_election.cc:302] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 8eeb1bf38cc044959c8ebb9fccc2a13e; no voters:
I20260807 06:55:14.725873 14484 raft_consensus.cc:2781] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:14.725953 14484 raft_consensus.cc:482] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:14.726019 14484 raft_consensus.cc:3037] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:14.727937 14484 raft_consensus.cc:504] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:14.728736 14484 leader_election.cc:288] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 election: Requested vote from peers 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221), 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691)
I20260807 06:55:14.729164 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87bda40a8af44ec85793c0a5d39189d" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e"
I20260807 06:55:14.729435 14159 raft_consensus.cc:3037] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:14.729440 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e87bda40a8af44ec85793c0a5d39189d" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95"
I20260807 06:55:14.729691 14350 raft_consensus.cc:3037] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:14.732445 14159 raft_consensus.cc:2454] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 1.
I20260807 06:55:14.732473 14350 raft_consensus.cc:2454] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 1.
I20260807 06:55:14.732890 13828 leader_election.cc:302] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 6c73622804bc4ace9df1025abe5dad95; no voters:
I20260807 06:55:14.733194 14484 raft_consensus.cc:2781] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:14.733371 14484 raft_consensus.cc:686] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [term 1 LEADER]: Becoming Leader. State: Replica: 40b22220931c462ba00fb2a8e0ecb87c, State: Running, Role: LEADER
I20260807 06:55:14.733618 14484 consensus_queue.cc:237] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:14.735203 14490 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: TxnStatusTablet state changed. Reason: New leader 40b22220931c462ba00fb2a8e0ecb87c. Latest consensus state: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.735494 14490 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:55:14.736100 14509 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 06:55:14.736435 14509 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 06:55:14.737238 13670 catalog_manager.cc:5495] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c reported cstate change: term changed from 0 to 1, leader changed from <none> to 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129). New cstate: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260807 06:55:14.788848 14502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.781360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:33147 (local address 127.0.0.1:50018)
0807 06:55:14.781655 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:14.781676 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.781826 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.782974 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.782979 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.782990 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:55:14.783161 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.783169 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.784687 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.784690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.785751 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.785764 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.786910 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.786915 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.787062 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.787125 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:55:14.788364 (+ 1239us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:55:14.788390 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.788481 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.788609 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 06:55:14.789083 14512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.781428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50018 (local address 127.10.191.129:33147)
0807 06:55:14.782512 (+ 1084us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.782519 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.782543 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:55:14.782653 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.782658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.782758 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.782932 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:14.783322 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.784548 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.785893 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.786652 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.786786 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.787399 (+ 613us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:14.788214 (+ 815us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:14.788367 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.788550 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.788648 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":918,"thread_start_us":713,"threads_started":1}
I20260807 06:55:14.797570 14159 raft_consensus.cc:1261] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Refusing update from remote peer 40b22220931c462ba00fb2a8e0ecb87c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:14.797565 14350 raft_consensus.cc:1261] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Refusing update from remote peer 40b22220931c462ba00fb2a8e0ecb87c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:14.798681 14490 consensus_queue.cc:1035] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:14.799095 14484 consensus_queue.cc:1035] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:14.814978 14485 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: TxnStatusTablet state changed. Reason: New leader 40b22220931c462ba00fb2a8e0ecb87c. Latest consensus state: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.815321 14485 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:14.816419 14485 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.816658 14485 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 6c73622804bc4ace9df1025abe5dad95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:14.817305 14483 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: TxnStatusTablet state changed. Reason: New leader 40b22220931c462ba00fb2a8e0ecb87c. Latest consensus state: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.817595 14483 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:14.837138 14483 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.837558 14483 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 8eeb1bf38cc044959c8ebb9fccc2a13e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:55:14.840348 14484 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.840412 14527 tablet_replica.cc:439] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } } }
I20260807 06:55:14.840844 14527 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:55:14.840732 14484 tablet_replica.cc:442] T e87bda40a8af44ec85793c0a5d39189d P 40b22220931c462ba00fb2a8e0ecb87c: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:55:14.850986 14512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.844268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50026 (local address 127.10.191.129:33147)
0807 06:55:14.844518 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.844528 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.845010 (+ 482us) server_negotiation.cc:407] Connection header received
0807 06:55:14.845293 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.845298 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.845376 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.845487 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:14.846071 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.846868 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.848886 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.849496 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.849616 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.850178 (+ 562us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:14.850295 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:14.850370 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.850546 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.850620 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 06:55:14.871479 14512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.864640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:43049 (local address 127.10.191.129:33147)
0807 06:55:14.864870 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:14.864880 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:14.865681 (+ 801us) server_negotiation.cc:407] Connection header received
0807 06:55:14.865950 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:14.865956 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:14.866028 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:14.866147 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:14.866744 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.867476 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.869171 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.869850 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.870031 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.870587 (+ 556us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:14.870703 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:14.870812 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:14.870982 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 06:55:14.871052 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 06:55:14.871613 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:14.864625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:33147 (local address 127.10.191.129:43049)
0807 06:55:14.865565 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:14.865583 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:14.865781 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:14.866149 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:14.866153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:14.866164 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:55:14.866589 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.866600 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.867633 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.867640 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.868973 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:14.868988 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:14.870092 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:14.870106 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:14.870264 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:14.870331 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:55:14.870812 (+ 481us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:55:14.870827 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 06:55:14.870962 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 06:55:14.871097 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":22,"thread_start_us":560,"threads_started":1}
I20260807 06:55:14.883509 14350 raft_consensus.cc:1261] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Refusing update from remote peer 40b22220931c462ba00fb2a8e0ecb87c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:14.883510 14159 raft_consensus.cc:1261] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Refusing update from remote peer 40b22220931c462ba00fb2a8e0ecb87c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:14.884251 14527 consensus_queue.cc:1035] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:14.884625 14484 consensus_queue.cc:1035] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:14.890084 14516 mvcc.cc:205] Tried to move back new op lower bound from 7315807088156704768 to 7315807086348525568. Current Snapshot: MvccSnapshot[applied={T|T < 7315807088156704768}]
I20260807 06:55:14.891988 14518 mvcc.cc:205] Tried to move back new op lower bound from 7315807088156704768 to 7315807086348525568. Current Snapshot: MvccSnapshot[applied={T|T < 7315807088156704768}]
I20260807 06:55:14.963874 13670 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:14.964274 13670 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:14.970561 13670 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9: Sending DeleteTablet for 3 replicas of tablet 39f8efb9b2c84179865a6a944c17f862
I20260807 06:55:14.972913 14119 tablet_service.cc:1514] Processing DeleteTablet for tablet 39f8efb9b2c84179865a6a944c17f862 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:14 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:36610
I20260807 06:55:14.972477 14323 tablet_service.cc:1514] Processing DeleteTablet for tablet 39f8efb9b2c84179865a6a944c17f862 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:14 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:34664
I20260807 06:55:14.974447 13670 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59738:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:14.975258 13670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:14.976771 14546 tablet_replica.cc:330] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: stopping tablet replica
I20260807 06:55:14.977514 14546 raft_consensus.cc:2229] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:14.977667 13896 tablet_service.cc:1514] Processing DeleteTablet for tablet 39f8efb9b2c84179865a6a944c17f862 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:14 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:50002
I20260807 06:55:14.978091 14546 raft_consensus.cc:2258] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:14.980727 14546 ts_tablet_manager.cc:1905] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:14.984541 14322 tablet_service.cc:1467] Processing CreateTablet for tablet dcdf62c593364105928523a9e8909225 (DEFAULT_TABLE table=test-table [id=916ec523237748ea9fdd9d582abd6ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:14.984836 13895 tablet_service.cc:1467] Processing CreateTablet for tablet dcdf62c593364105928523a9e8909225 (DEFAULT_TABLE table=test-table [id=916ec523237748ea9fdd9d582abd6ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:14.984907 14119 tablet_service.cc:1467] Processing CreateTablet for tablet dcdf62c593364105928523a9e8909225 (DEFAULT_TABLE table=test-table [id=916ec523237748ea9fdd9d582abd6ad8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:14.985150 14322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcdf62c593364105928523a9e8909225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:14.985333 13895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcdf62c593364105928523a9e8909225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:14.985414 14119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcdf62c593364105928523a9e8909225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:14.990006 14546 ts_tablet_manager.cc:1918] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:55:14.990298 14546 log.cc:1196] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/39f8efb9b2c84179865a6a944c17f862
I20260807 06:55:14.991037 14546 ts_tablet_manager.cc:1939] T 39f8efb9b2c84179865a6a944c17f862 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting consensus metadata
I20260807 06:55:14.992640 14474 tablet_bootstrap.cc:492] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: Bootstrap starting.
I20260807 06:55:14.994803 14474 tablet_bootstrap.cc:654] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:14.996889 14473 tablet_bootstrap.cc:492] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Bootstrap starting.
I20260807 06:55:14.999298 14476 tablet_bootstrap.cc:492] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: Bootstrap starting.
I20260807 06:55:15.001606 14473 tablet_bootstrap.cc:654] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:15.002465 14476 tablet_bootstrap.cc:654] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:15.004245 13649 catalog_manager.cc:4841] TS 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221): tablet 39f8efb9b2c84179865a6a944c17f862 (table test-table [id=c795e9794b03497a92c8012820f50aac]) successfully deleted
I20260807 06:55:15.005537 14473 tablet_bootstrap.cc:492] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: No bootstrap required, opened a new log
I20260807 06:55:15.005754 14473 ts_tablet_manager.cc:1397] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260807 06:55:15.006351 14547 tablet_replica.cc:330] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: stopping tablet replica
I20260807 06:55:15.006371 14548 tablet_replica.cc:330] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: stopping tablet replica
I20260807 06:55:15.006467 14474 tablet_bootstrap.cc:492] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: No bootstrap required, opened a new log
I20260807 06:55:15.006676 14474 ts_tablet_manager.cc:1397] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.005s
I20260807 06:55:15.006875 14548 raft_consensus.cc:2229] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:15.006904 14547 raft_consensus.cc:2229] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:15.007359 14547 raft_consensus.cc:2258] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:15.007553 14474 raft_consensus.cc:348] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:15.007726 14548 raft_consensus.cc:2258] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:15.007820 14474 raft_consensus.cc:374] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:15.007373 14473 raft_consensus.cc:348] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:15.008069 14473 raft_consensus.cc:374] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:15.008162 14473 raft_consensus.cc:729] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eeb1bf38cc044959c8ebb9fccc2a13e, State: Initialized, Role: FOLLOWER
I20260807 06:55:15.007911 14474 raft_consensus.cc:729] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73622804bc4ace9df1025abe5dad95, State: Initialized, Role: FOLLOWER
I20260807 06:55:15.009177 14473 consensus_queue.cc:260] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:15.009177 14474 consensus_queue.cc:260] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:15.009909 14473 ts_tablet_manager.cc:1428] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 06:55:15.010008 14548 ts_tablet_manager.cc:1905] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:15.013309 14474 ts_tablet_manager.cc:1428] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260807 06:55:15.015723 14547 ts_tablet_manager.cc:1905] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:15.018539 14548 ts_tablet_manager.cc:1918] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:55:15.018785 14548 log.cc:1196] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/39f8efb9b2c84179865a6a944c17f862
I20260807 06:55:15.019419 14548 ts_tablet_manager.cc:1939] T 39f8efb9b2c84179865a6a944c17f862 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting consensus metadata
I20260807 06:55:15.021363 13649 catalog_manager.cc:4841] TS 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129:33147): tablet 39f8efb9b2c84179865a6a944c17f862 (table test-table [id=c795e9794b03497a92c8012820f50aac]) successfully deleted
I20260807 06:55:15.024319 14476 tablet_bootstrap.cc:492] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: No bootstrap required, opened a new log
I20260807 06:55:15.024503 14476 ts_tablet_manager.cc:1397] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.009s
I20260807 06:55:15.025331 14476 raft_consensus.cc:348] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:15.025609 14476 raft_consensus.cc:374] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:15.025686 14476 raft_consensus.cc:729] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40b22220931c462ba00fb2a8e0ecb87c, State: Initialized, Role: FOLLOWER
I20260807 06:55:15.025990 14476 consensus_queue.cc:260] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:15.027169 14547 ts_tablet_manager.cc:1918] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:55:15.027390 14547 log.cc:1196] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/39f8efb9b2c84179865a6a944c17f862
I20260807 06:55:15.027716 14476 ts_tablet_manager.cc:1428] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:15.027945 14547 ts_tablet_manager.cc:1939] T 39f8efb9b2c84179865a6a944c17f862 P 6c73622804bc4ace9df1025abe5dad95: Deleting consensus metadata
I20260807 06:55:15.029724 13652 catalog_manager.cc:4841] TS 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691): tablet 39f8efb9b2c84179865a6a944c17f862 (table test-table [id=c795e9794b03497a92c8012820f50aac]) successfully deleted
I20260807 06:55:15.099277 14484 raft_consensus.cc:482] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:15.099485 14484 raft_consensus.cc:504] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:15.100322 14484 leader_election.cc:288] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221), 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691)
I20260807 06:55:15.101003 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcdf62c593364105928523a9e8909225" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95" is_pre_election: true
I20260807 06:55:15.101054 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcdf62c593364105928523a9e8909225" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" is_pre_election: true
I20260807 06:55:15.101315 14350 raft_consensus.cc:2454] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 0.
I20260807 06:55:15.101380 14159 raft_consensus.cc:2454] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 0.
I20260807 06:55:15.101920 13826 leader_election.cc:302] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 6c73622804bc4ace9df1025abe5dad95, 8eeb1bf38cc044959c8ebb9fccc2a13e; no voters:
I20260807 06:55:15.102252 14484 raft_consensus.cc:2781] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:15.102387 14484 raft_consensus.cc:482] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:15.102514 14484 raft_consensus.cc:3037] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:15.105603 14484 raft_consensus.cc:504] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:15.106360 14484 leader_election.cc:288] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 election: Requested vote from peers 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221), 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691)
I20260807 06:55:15.106844 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcdf62c593364105928523a9e8909225" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e"
I20260807 06:55:15.107090 14159 raft_consensus.cc:3037] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:15.107015 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcdf62c593364105928523a9e8909225" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95"
I20260807 06:55:15.107276 14350 raft_consensus.cc:3037] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:15.110239 14159 raft_consensus.cc:2454] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 1.
I20260807 06:55:15.110226 14350 raft_consensus.cc:2454] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 1.
I20260807 06:55:15.110805 13826 leader_election.cc:302] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 8eeb1bf38cc044959c8ebb9fccc2a13e; no voters:
I20260807 06:55:15.111161 14484 raft_consensus.cc:2781] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:15.111361 14484 raft_consensus.cc:686] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 LEADER]: Becoming Leader. State: Replica: 40b22220931c462ba00fb2a8e0ecb87c, State: Running, Role: LEADER
I20260807 06:55:15.111706 14484 consensus_queue.cc:237] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:15.114964 13670 catalog_manager.cc:5495] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c reported cstate change: term changed from 0 to 1, leader changed from <none> to 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129). New cstate: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260807 06:55:15.152673 14350 raft_consensus.cc:1261] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Refusing update from remote peer 40b22220931c462ba00fb2a8e0ecb87c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:15.153331 14490 consensus_queue.cc:1035] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:15.153690 14159 raft_consensus.cc:1261] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Refusing update from remote peer 40b22220931c462ba00fb2a8e0ecb87c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:15.154244 14490 consensus_queue.cc:1035] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 06:55:15.186152 14516 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 06:55:16.776479 13669 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:16.776790 13669 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:16.781143 13669 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9: Sending DeleteTablet for 3 replicas of tablet dcdf62c593364105928523a9e8909225
I20260807 06:55:16.781996 13896 tablet_service.cc:1514] Processing DeleteTablet for tablet dcdf62c593364105928523a9e8909225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:16 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:50002
I20260807 06:55:16.782096 14119 tablet_service.cc:1514] Processing DeleteTablet for tablet dcdf62c593364105928523a9e8909225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:16 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:36610
I20260807 06:55:16.782130 14323 tablet_service.cc:1514] Processing DeleteTablet for tablet dcdf62c593364105928523a9e8909225 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:16 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:34664
I20260807 06:55:16.792838 14602 tablet_replica.cc:330] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: stopping tablet replica
I20260807 06:55:16.793298 14602 raft_consensus.cc:2229] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:16.793715 14602 raft_consensus.cc:2258] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:16.794932 14602 ts_tablet_manager.cc:1905] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:16.796347 14601 tablet_replica.cc:330] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: stopping tablet replica
I20260807 06:55:16.796554 14601 raft_consensus.cc:2229] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:16.796643 14600 tablet_replica.cc:330] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: stopping tablet replica
I20260807 06:55:16.796844 14601 raft_consensus.cc:2258] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:16.796898 14600 raft_consensus.cc:2229] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:16.797398 14600 raft_consensus.cc:2258] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:16.797879 14601 ts_tablet_manager.cc:1905] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:16.798328 14600 ts_tablet_manager.cc:1905] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:16.801877 14602 ts_tablet_manager.cc:1918] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:55:16.802030 14602 log.cc:1196] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/dcdf62c593364105928523a9e8909225
I20260807 06:55:16.802491 14602 ts_tablet_manager.cc:1939] T dcdf62c593364105928523a9e8909225 P 6c73622804bc4ace9df1025abe5dad95: Deleting consensus metadata
I20260807 06:55:16.803872 14600 ts_tablet_manager.cc:1918] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:55:16.803822 13652 catalog_manager.cc:4841] TS 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691): tablet dcdf62c593364105928523a9e8909225 (table test-table [id=916ec523237748ea9fdd9d582abd6ad8]) successfully deleted
I20260807 06:55:16.804026 14600 log.cc:1196] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/dcdf62c593364105928523a9e8909225
I20260807 06:55:16.804491 14601 ts_tablet_manager.cc:1918] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:55:16.804520 14600 ts_tablet_manager.cc:1939] T dcdf62c593364105928523a9e8909225 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting consensus metadata
I20260807 06:55:16.804637 14601 log.cc:1196] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/dcdf62c593364105928523a9e8909225
I20260807 06:55:16.805003 14601 ts_tablet_manager.cc:1939] T dcdf62c593364105928523a9e8909225 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting consensus metadata
I20260807 06:55:16.805658 13649 catalog_manager.cc:4841] TS 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129:33147): tablet dcdf62c593364105928523a9e8909225 (table test-table [id=916ec523237748ea9fdd9d582abd6ad8]) successfully deleted
I20260807 06:55:16.806142 13649 catalog_manager.cc:4841] TS 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221): tablet dcdf62c593364105928523a9e8909225 (table test-table [id=916ec523237748ea9fdd9d582abd6ad8]) successfully deleted
Aug 07 06:55:16 dist-test-slave-tfpf krb5kdc[13608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085716, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:55:16 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085716, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:16.855546 14614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:16.840513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54080 (local address 127.10.191.190:37775)
0807 06:55:16.841392 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:16.841396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:16.841421 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:55:16.841478 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:16.841482 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:16.841541 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:16.841641 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:16.842916 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.843660 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.844759 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.845213 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.845315 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:16.849448 (+ 4133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:16.849456 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:16.849460 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:16.849520 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:16.852881 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:16.853618 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:16.853622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:16.853624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:16.853776 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:16.854136 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:16.854140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:16.854142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:16.854482 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:16.854707 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:16.854962 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 06:55:16.855146 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":766,"thread_start_us":619,"threads_started":1}
I20260807 06:55:16.859331 13669 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:16.860023 13669 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:16.867043 13896 tablet_service.cc:1467] Processing CreateTablet for tablet b66f74381f1540b9a409072920e55cc3 (DEFAULT_TABLE table=test-table [id=ac604876b6404bf685c769233ffd245b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:16.867238 14119 tablet_service.cc:1467] Processing CreateTablet for tablet b66f74381f1540b9a409072920e55cc3 (DEFAULT_TABLE table=test-table [id=ac604876b6404bf685c769233ffd245b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:16.867589 13896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b66f74381f1540b9a409072920e55cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:16.867739 14119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b66f74381f1540b9a409072920e55cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:16.869956 14323 tablet_service.cc:1467] Processing CreateTablet for tablet b66f74381f1540b9a409072920e55cc3 (DEFAULT_TABLE table=test-table [id=ac604876b6404bf685c769233ffd245b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:16.870386 14323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b66f74381f1540b9a409072920e55cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:16.874190 14615 tablet_bootstrap.cc:492] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Bootstrap starting.
I20260807 06:55:16.875782 14615 tablet_bootstrap.cc:654] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:16.878772 14618 tablet_bootstrap.cc:492] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: Bootstrap starting.
I20260807 06:55:16.880254 14615 tablet_bootstrap.cc:492] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: No bootstrap required, opened a new log
I20260807 06:55:16.880424 14615 ts_tablet_manager.cc:1397] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 06:55:16.880744 14618 tablet_bootstrap.cc:654] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:16.881788 14615 raft_consensus.cc:348] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:16.882148 14615 raft_consensus.cc:374] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:16.882172 14616 tablet_bootstrap.cc:492] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: Bootstrap starting.
I20260807 06:55:16.882256 14615 raft_consensus.cc:729] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eeb1bf38cc044959c8ebb9fccc2a13e, State: Initialized, Role: FOLLOWER
I20260807 06:55:16.882560 14615 consensus_queue.cc:260] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:16.883721 14615 ts_tablet_manager.cc:1428] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:16.883922 14616 tablet_bootstrap.cc:654] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:16.887018 14616 tablet_bootstrap.cc:492] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: No bootstrap required, opened a new log
I20260807 06:55:16.887313 14616 ts_tablet_manager.cc:1397] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 06:55:16.888228 14616 raft_consensus.cc:348] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:16.888489 14616 raft_consensus.cc:374] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:16.888603 14616 raft_consensus.cc:729] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40b22220931c462ba00fb2a8e0ecb87c, State: Initialized, Role: FOLLOWER
I20260807 06:55:16.888873 14616 consensus_queue.cc:260] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:16.889492 14616 ts_tablet_manager.cc:1428] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:55:16.889693 14618 tablet_bootstrap.cc:492] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: No bootstrap required, opened a new log
I20260807 06:55:16.889892 14618 ts_tablet_manager.cc:1397] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260807 06:55:16.890535 14618 raft_consensus.cc:348] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:16.890762 14618 raft_consensus.cc:374] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:16.890872 14618 raft_consensus.cc:729] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73622804bc4ace9df1025abe5dad95, State: Initialized, Role: FOLLOWER
I20260807 06:55:16.891165 14618 consensus_queue.cc:260] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:16.892354 14618 ts_tablet_manager.cc:1428] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 06:55:16.953228 14620 raft_consensus.cc:482] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:16.953480 14620 raft_consensus.cc:504] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:16.954970 14620 leader_election.cc:288] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129:33147), 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691)
I20260807 06:55:16.966061 14634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:16.955436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:43701 (local address 127.10.191.129:33147)
0807 06:55:16.957814 (+ 2378us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:16.957820 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:16.957842 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:55:16.957910 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:16.957914 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:16.958003 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:16.958101 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:16.959047 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.960291 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.963369 (+ 3078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.964617 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.964860 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:16.964930 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:16.965544 (+ 614us) server_negotiation.cc:299] Negotiation successful
0807 06:55:16.965687 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2193,"thread_start_us":2023,"threads_started":1}
I20260807 06:55:16.966204 14628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:16.955436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:35729 (local address 127.10.191.131:40691)
0807 06:55:16.957636 (+ 2200us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:16.957642 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:16.957676 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:55:16.957853 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:16.957861 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:16.957937 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:16.958069 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:16.959047 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.960296 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.963363 (+ 3067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.964640 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.964818 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:16.964898 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:16.965530 (+ 632us) server_negotiation.cc:299] Negotiation successful
0807 06:55:16.965721 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2054,"thread_start_us":1355,"threads_started":1}
I20260807 06:55:16.966113 14627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:16.955334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:33147 (local address 127.10.191.130:43701)
0807 06:55:16.956204 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:16.956230 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:16.956408 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:16.958123 (+ 1715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:16.958126 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:16.958166 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:16.958802 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:16.958826 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.960443 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.960449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:16.963183 (+ 2734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:16.963201 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.964855 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.964859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:16.965220 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:16.965329 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 06:55:16.965422 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 06:55:16.965608 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":422,"spinlock_wait_cycles":5504,"thread_start_us":1801,"threads_started":1}
I20260807 06:55:16.967195 14631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:16.955364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:40691 (local address 127.10.191.130:35729)
0807 06:55:16.957571 (+ 2207us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:16.957592 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:16.957707 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:16.958109 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:16.958114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:16.958140 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:16.958874 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:16.958885 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.960446 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.960449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:16.963183 (+ 2734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:16.963201 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:16.964841 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:16.964849 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:16.965220 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:16.965326 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 06:55:16.965422 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 06:55:16.966725 (+ 1303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2080,"mutex_wait_us":416,"thread_start_us":482,"threads_started":1}
I20260807 06:55:16.967535 13930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b66f74381f1540b9a409072920e55cc3" candidate_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40b22220931c462ba00fb2a8e0ecb87c" is_pre_election: true
I20260807 06:55:16.968030 13930 raft_consensus.cc:2454] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8eeb1bf38cc044959c8ebb9fccc2a13e in term 0.
I20260807 06:55:16.967938 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b66f74381f1540b9a409072920e55cc3" candidate_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95" is_pre_election: true
I20260807 06:55:16.968235 14350 raft_consensus.cc:2454] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8eeb1bf38cc044959c8ebb9fccc2a13e in term 0.
I20260807 06:55:16.968827 14045 leader_election.cc:302] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 8eeb1bf38cc044959c8ebb9fccc2a13e; no voters:
I20260807 06:55:16.969614 14620 raft_consensus.cc:2781] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:16.969771 14620 raft_consensus.cc:482] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:16.969914 14620 raft_consensus.cc:3037] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:16.973403 14620 raft_consensus.cc:504] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:16.974188 14620 leader_election.cc:288] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [CANDIDATE]: Term 1 election: Requested vote from peers 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129:33147), 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691)
I20260807 06:55:16.974699 13930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b66f74381f1540b9a409072920e55cc3" candidate_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40b22220931c462ba00fb2a8e0ecb87c"
I20260807 06:55:16.974787 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b66f74381f1540b9a409072920e55cc3" candidate_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95"
I20260807 06:55:16.974922 13930 raft_consensus.cc:3037] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:16.975035 14350 raft_consensus.cc:3037] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:16.977308 14350 raft_consensus.cc:2454] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eeb1bf38cc044959c8ebb9fccc2a13e in term 1.
I20260807 06:55:16.977337 13930 raft_consensus.cc:2454] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eeb1bf38cc044959c8ebb9fccc2a13e in term 1.
I20260807 06:55:16.977862 14045 leader_election.cc:302] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 6c73622804bc4ace9df1025abe5dad95, 8eeb1bf38cc044959c8ebb9fccc2a13e; no voters:
I20260807 06:55:16.978185 14620 raft_consensus.cc:2781] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:16.978667 14620 raft_consensus.cc:686] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 LEADER]: Becoming Leader. State: Replica: 8eeb1bf38cc044959c8ebb9fccc2a13e, State: Running, Role: LEADER
I20260807 06:55:16.979058 14620 consensus_queue.cc:237] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:16.982620 13673 catalog_manager.cc:5495] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130). New cstate: current_term: 1 leader_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260807 06:55:17.015529 14641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:17.009456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40624 (local address 127.10.191.130:42221)
0807 06:55:17.010129 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:17.010134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:17.010152 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:55:17.010239 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:17.010242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:17.010317 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:17.010499 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:17.010975 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.011792 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.013153 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.013615 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.013749 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:17.014257 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:17.014857 (+ 600us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:17.015030 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:17.015110 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 06:55:17.015192 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":355,"threads_started":1}
I20260807 06:55:17.031407 14634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:17.026121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:58917 (local address 127.10.191.129:33147)
0807 06:55:17.026298 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:17.026304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:17.026924 (+ 620us) server_negotiation.cc:407] Connection header received
0807 06:55:17.027103 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:17.027107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:17.027179 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:17.027257 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:17.027707 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.028465 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.029939 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.030342 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.030439 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:17.030835 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:17.030937 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:17.031004 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:17.031141 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 06:55:17.031208 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 06:55:17.031474 14644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:17.026105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:33147 (local address 127.10.191.130:58917)
0807 06:55:17.026826 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:17.026847 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:17.026974 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:17.027284 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:17.027286 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:17.027295 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:55:17.027576 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:17.027583 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.028586 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.028589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:17.029783 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:17.029797 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.030493 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.030497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:17.030623 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:17.030679 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:55:17.031021 (+ 342us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:55:17.031029 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 06:55:17.031102 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:55:17.031197 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":375,"threads_started":1}
I20260807 06:55:17.040434 14350 raft_consensus.cc:1261] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Refusing update from remote peer 8eeb1bf38cc044959c8ebb9fccc2a13e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:17.040941 13930 raft_consensus.cc:1261] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Refusing update from remote peer 8eeb1bf38cc044959c8ebb9fccc2a13e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:17.041249 14635 consensus_queue.cc:1035] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:17.041718 14620 consensus_queue.cc:1035] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:17.047809 14572 mvcc.cc:205] Tried to move back new op lower bound from 7315807096992272384 to 7315807096750100480. Current Snapshot: MvccSnapshot[applied={T|T < 7315807096992272384}]
I20260807 06:55:17.073387 14641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:17.067025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:40905 (local address 127.10.191.130:42221)
0807 06:55:17.067312 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:17.067318 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:17.067402 (+ 84us) server_negotiation.cc:407] Connection header received
0807 06:55:17.067606 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:17.067612 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:17.067692 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:17.067781 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:17.068463 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.069465 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.071439 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.072030 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.072155 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:17.072629 (+ 474us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:17.072741 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:17.072852 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:17.072988 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 06:55:17.073098 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260807 06:55:17.073484 14651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:17.066738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:42221 (local address 127.10.191.129:40905)
0807 06:55:17.067316 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:17.067342 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:17.067460 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:17.067960 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:17.067965 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:17.067978 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:55:17.068268 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:17.068279 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.069607 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.069613 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:17.071292 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:17.071307 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.072297 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.072302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:17.072423 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:17.072460 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:55:17.072854 (+ 394us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:55:17.072867 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 06:55:17.072949 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 06:55:17.073122 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":309,"threads_started":1}
I20260807 06:55:17.105638 13669 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:17.105940 13669 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:17.109223 13669 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9: Sending DeleteTablet for 3 replicas of tablet b66f74381f1540b9a409072920e55cc3
I20260807 06:55:17.110311 14323 tablet_service.cc:1514] Processing DeleteTablet for tablet b66f74381f1540b9a409072920e55cc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:17 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:34664
I20260807 06:55:17.110306 14119 tablet_service.cc:1514] Processing DeleteTablet for tablet b66f74381f1540b9a409072920e55cc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:17 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:36610
I20260807 06:55:17.110642 14601 tablet_replica.cc:330] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: stopping tablet replica
I20260807 06:55:17.110814 14602 tablet_replica.cc:330] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: stopping tablet replica
I20260807 06:55:17.110867 14601 raft_consensus.cc:2229] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:17.111034 14602 raft_consensus.cc:2229] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:17.111280 14602 raft_consensus.cc:2258] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:17.111447 14601 raft_consensus.cc:2258] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:17.111500 13669 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:17.112203 13669 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:17.112740 14601 ts_tablet_manager.cc:1905] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:17.112910 14602 ts_tablet_manager.cc:1905] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:17.119092 13896 tablet_service.cc:1514] Processing DeleteTablet for tablet b66f74381f1540b9a409072920e55cc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:17 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:50002
I20260807 06:55:17.119438 14600 tablet_replica.cc:330] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: stopping tablet replica
I20260807 06:55:17.119664 14600 raft_consensus.cc:2229] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:17.119927 14600 raft_consensus.cc:2258] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:17.120090 14602 ts_tablet_manager.cc:1918] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:55:17.120347 14602 log.cc:1196] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/b66f74381f1540b9a409072920e55cc3
I20260807 06:55:17.120298 14323 tablet_service.cc:1467] Processing CreateTablet for tablet 13c25a65391f4652b71e3450dffef199 (DEFAULT_TABLE table=test-table [id=e4cd4cbcee9540bb8685557bad554600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:17.120791 14323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13c25a65391f4652b71e3450dffef199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:17.120795 14119 tablet_service.cc:1467] Processing CreateTablet for tablet 13c25a65391f4652b71e3450dffef199 (DEFAULT_TABLE table=test-table [id=e4cd4cbcee9540bb8685557bad554600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:17.121287 14119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13c25a65391f4652b71e3450dffef199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:17.123169 14602 ts_tablet_manager.cc:1939] T b66f74381f1540b9a409072920e55cc3 P 6c73622804bc4ace9df1025abe5dad95: Deleting consensus metadata
I20260807 06:55:17.123473 13896 tablet_service.cc:1467] Processing CreateTablet for tablet 13c25a65391f4652b71e3450dffef199 (DEFAULT_TABLE table=test-table [id=e4cd4cbcee9540bb8685557bad554600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:17.123960 13896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13c25a65391f4652b71e3450dffef199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:17.125612 13652 catalog_manager.cc:4841] TS 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691): tablet b66f74381f1540b9a409072920e55cc3 (table test-table [id=ac604876b6404bf685c769233ffd245b]) successfully deleted
I20260807 06:55:17.127259 14618 tablet_bootstrap.cc:492] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: Bootstrap starting.
I20260807 06:55:17.129133 14618 tablet_bootstrap.cc:654] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:17.130774 14616 tablet_bootstrap.cc:492] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: Bootstrap starting.
I20260807 06:55:17.132565 14616 tablet_bootstrap.cc:654] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:17.139686 14601 ts_tablet_manager.cc:1918] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:55:17.140995 14600 ts_tablet_manager.cc:1905] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:17.142798 14601 log.cc:1196] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/b66f74381f1540b9a409072920e55cc3
I20260807 06:55:17.143251 14615 tablet_bootstrap.cc:492] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Bootstrap starting.
I20260807 06:55:17.146027 14601 ts_tablet_manager.cc:1939] T b66f74381f1540b9a409072920e55cc3 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting consensus metadata
I20260807 06:55:17.146692 14618 tablet_bootstrap.cc:492] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: No bootstrap required, opened a new log
I20260807 06:55:17.146029 14615 tablet_bootstrap.cc:654] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:17.146896 14618 ts_tablet_manager.cc:1397] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.014s
I20260807 06:55:17.147838 13649 catalog_manager.cc:4841] TS 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221): tablet b66f74381f1540b9a409072920e55cc3 (table test-table [id=ac604876b6404bf685c769233ffd245b]) successfully deleted
I20260807 06:55:17.147765 14618 raft_consensus.cc:348] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:17.148054 14618 raft_consensus.cc:374] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:17.148137 14618 raft_consensus.cc:729] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73622804bc4ace9df1025abe5dad95, State: Initialized, Role: FOLLOWER
I20260807 06:55:17.148386 14618 consensus_queue.cc:260] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:17.149104 14618 ts_tablet_manager.cc:1428] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260807 06:55:17.150940 14615 tablet_bootstrap.cc:492] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: No bootstrap required, opened a new log
I20260807 06:55:17.151172 14615 ts_tablet_manager.cc:1397] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 06:55:17.152279 14615 raft_consensus.cc:348] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:17.152617 14615 raft_consensus.cc:374] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:17.152726 14615 raft_consensus.cc:729] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eeb1bf38cc044959c8ebb9fccc2a13e, State: Initialized, Role: FOLLOWER
I20260807 06:55:17.153119 14615 consensus_queue.cc:260] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:17.153823 14615 ts_tablet_manager.cc:1428] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 06:55:17.155337 14600 ts_tablet_manager.cc:1918] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:55:17.155591 14600 log.cc:1196] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/b66f74381f1540b9a409072920e55cc3
I20260807 06:55:17.156213 14600 ts_tablet_manager.cc:1939] T b66f74381f1540b9a409072920e55cc3 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting consensus metadata
I20260807 06:55:17.156586 14616 tablet_bootstrap.cc:492] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: No bootstrap required, opened a new log
I20260807 06:55:17.156816 14616 ts_tablet_manager.cc:1397] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.011s
I20260807 06:55:17.157671 13649 catalog_manager.cc:4841] TS 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129:33147): tablet b66f74381f1540b9a409072920e55cc3 (table test-table [id=ac604876b6404bf685c769233ffd245b]) successfully deleted
I20260807 06:55:17.157721 14616 raft_consensus.cc:348] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:17.157994 14616 raft_consensus.cc:374] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:17.158083 14616 raft_consensus.cc:729] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40b22220931c462ba00fb2a8e0ecb87c, State: Initialized, Role: FOLLOWER
I20260807 06:55:17.158320 14616 consensus_queue.cc:260] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:17.158947 14616 ts_tablet_manager.cc:1428] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 06:55:17.317142 14576 raft_consensus.cc:482] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:17.317406 14576 raft_consensus.cc:504] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:17.318234 14576 leader_election.cc:288] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221), 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691)
I20260807 06:55:17.318892 14156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c25a65391f4652b71e3450dffef199" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" is_pre_election: true
I20260807 06:55:17.318944 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c25a65391f4652b71e3450dffef199" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95" is_pre_election: true
I20260807 06:55:17.319190 14156 raft_consensus.cc:2454] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 0.
I20260807 06:55:17.319238 14350 raft_consensus.cc:2454] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 0.
I20260807 06:55:17.319717 13828 leader_election.cc:302] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 6c73622804bc4ace9df1025abe5dad95; no voters:
I20260807 06:55:17.320027 14576 raft_consensus.cc:2781] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:17.320158 14576 raft_consensus.cc:482] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:17.320250 14576 raft_consensus.cc:3037] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:17.323385 14576 raft_consensus.cc:504] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:17.324097 14576 leader_election.cc:288] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 election: Requested vote from peers 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221), 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691)
I20260807 06:55:17.324640 14156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c25a65391f4652b71e3450dffef199" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e"
I20260807 06:55:17.324640 14350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13c25a65391f4652b71e3450dffef199" candidate_uuid: "40b22220931c462ba00fb2a8e0ecb87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73622804bc4ace9df1025abe5dad95"
I20260807 06:55:17.324864 14350 raft_consensus.cc:3037] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:17.324872 14156 raft_consensus.cc:3037] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:17.328002 14350 raft_consensus.cc:2454] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 1.
I20260807 06:55:17.328006 14156 raft_consensus.cc:2454] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40b22220931c462ba00fb2a8e0ecb87c in term 1.
I20260807 06:55:17.328471 13828 leader_election.cc:302] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40b22220931c462ba00fb2a8e0ecb87c, 6c73622804bc4ace9df1025abe5dad95; no voters:
I20260807 06:55:17.328806 14576 raft_consensus.cc:2781] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:17.329107 14576 raft_consensus.cc:686] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 LEADER]: Becoming Leader. State: Replica: 40b22220931c462ba00fb2a8e0ecb87c, State: Running, Role: LEADER
I20260807 06:55:17.329401 14576 consensus_queue.cc:237] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } }
I20260807 06:55:17.332924 13673 catalog_manager.cc:5495] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c reported cstate change: term changed from 0 to 1, leader changed from <none> to 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129). New cstate: current_term: 1 leader_uuid: "40b22220931c462ba00fb2a8e0ecb87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40b22220931c462ba00fb2a8e0ecb87c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 } health_report { overall_health: UNKNOWN } } }
I20260807 06:55:17.391323 14634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:17.385599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42608 (local address 127.10.191.129:33147)
0807 06:55:17.385782 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:17.385789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:17.385858 (+ 69us) server_negotiation.cc:407] Connection header received
0807 06:55:17.386036 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:17.386042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:17.386147 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:17.386267 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:17.386621 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.387854 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.389151 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:17.389864 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:17.390048 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:17.390457 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:17.390612 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:17.390726 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:17.390835 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 06:55:17.390940 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:55:17.402670 14350 raft_consensus.cc:1261] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Refusing update from remote peer 40b22220931c462ba00fb2a8e0ecb87c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:17.402912 14156 raft_consensus.cc:1261] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Refusing update from remote peer 40b22220931c462ba00fb2a8e0ecb87c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:17.403352 14563 consensus_queue.cc:1035] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73622804bc4ace9df1025abe5dad95" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:17.403918 14563 consensus_queue.cc:1035] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eeb1bf38cc044959c8ebb9fccc2a13e" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 06:55:17.437569 14564 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 06:55:19.026058 13669 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:19.026319 13669 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:19.030547 13669 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68be8ac70c9a44f884927e6a00f226a9: Sending DeleteTablet for 3 replicas of tablet 13c25a65391f4652b71e3450dffef199
I20260807 06:55:19.031451 13895 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c25a65391f4652b71e3450dffef199 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:19 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:50002
I20260807 06:55:19.031555 14119 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c25a65391f4652b71e3450dffef199 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:19 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:36610
I20260807 06:55:19.031617 14323 tablet_service.cc:1514] Processing DeleteTablet for tablet 13c25a65391f4652b71e3450dffef199 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:19 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:34664
I20260807 06:55:19.032413 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 13799
I20260807 06:55:19.042698 14697 tablet_replica.cc:330] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: stopping tablet replica
I20260807 06:55:19.043262 14697 raft_consensus.cc:2229] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:19.043742 14697 raft_consensus.cc:2258] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:19.044531 14696 tablet_replica.cc:330] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: stopping tablet replica
I20260807 06:55:19.044826 14696 raft_consensus.cc:2229] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:19.045177 14696 raft_consensus.cc:2258] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:19.045547 14697 ts_tablet_manager.cc:1905] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:19.045687 14695 tablet_replica.cc:330] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: stopping tablet replica
I20260807 06:55:19.045953 14695 raft_consensus.cc:2229] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:19.046295 14696 ts_tablet_manager.cc:1905] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:19.046409 14695 raft_consensus.cc:2258] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:19.047545 14695 ts_tablet_manager.cc:1905] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:19.053319 14697 ts_tablet_manager.cc:1918] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:55:19.053155 14696 ts_tablet_manager.cc:1918] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:55:19.053601 14696 log.cc:1196] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/13c25a65391f4652b71e3450dffef199
I20260807 06:55:19.053639 14697 log.cc:1196] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/13c25a65391f4652b71e3450dffef199
I20260807 06:55:19.054113 14696 ts_tablet_manager.cc:1939] T 13c25a65391f4652b71e3450dffef199 P 8eeb1bf38cc044959c8ebb9fccc2a13e: Deleting consensus metadata
I20260807 06:55:19.054351 14697 ts_tablet_manager.cc:1939] T 13c25a65391f4652b71e3450dffef199 P 6c73622804bc4ace9df1025abe5dad95: Deleting consensus metadata
I20260807 06:55:19.054812 14695 ts_tablet_manager.cc:1918] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 06:55:19.054945 14695 log.cc:1196] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/13c25a65391f4652b71e3450dffef199
I20260807 06:55:19.055416 14695 ts_tablet_manager.cc:1939] T 13c25a65391f4652b71e3450dffef199 P 40b22220931c462ba00fb2a8e0ecb87c: Deleting consensus metadata
I20260807 06:55:19.055508 13649 catalog_manager.cc:4841] TS 8eeb1bf38cc044959c8ebb9fccc2a13e (127.10.191.130:42221): tablet 13c25a65391f4652b71e3450dffef199 (table test-table [id=e4cd4cbcee9540bb8685557bad554600]) successfully deleted
I20260807 06:55:19.055779 13652 catalog_manager.cc:4841] TS 6c73622804bc4ace9df1025abe5dad95 (127.10.191.131:40691): tablet 13c25a65391f4652b71e3450dffef199 (table test-table [id=e4cd4cbcee9540bb8685557bad554600]) successfully deleted
I20260807 06:55:19.056572 13649 catalog_manager.cc:4841] TS 40b22220931c462ba00fb2a8e0ecb87c (127.10.191.129:33147): tablet 13c25a65391f4652b71e3450dffef199 (table test-table [id=e4cd4cbcee9540bb8685557bad554600]) successfully deleted
Aug 07 06:55:19 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085716, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:19.073763 14702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:19.034799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42624 (local address 127.10.191.129:33147)
0807 06:55:19.040299 (+ 5500us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:19.040309 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:19.044906 (+ 4597us) server_negotiation.cc:407] Connection header received
0807 06:55:19.045214 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:19.045223 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:19.045384 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:19.045930 (+ 546us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:19.047921 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:19.049195 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:19.056415 (+ 7220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:19.057225 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:19.057353 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:19.066791 (+ 9438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:19.066814 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:19.066839 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:19.066907 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:19.070831 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:19.071577 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:19.071589 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:19.071593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:19.071765 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:19.072129 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:19.072134 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:19.072137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:19.072562 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:19.072845 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:19.073146 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 06:55:19.073384 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5274,"thread_start_us":5078,"threads_started":1}
W20260807 06:55:19.074467 14006 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42624
W20260807 06:55:19.075163 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 13799: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 06:55:19.075404 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 13799
I20260807 06:55:19.115684 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 14018
Aug 07 06:55:19 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085716, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:55:19.131668 14703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:19.116434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40628 (local address 127.10.191.130:42221)
0807 06:55:19.117025 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:19.117029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:19.117047 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:55:19.117162 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:19.117166 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:19.117225 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:19.117329 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:19.118598 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:19.119375 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:19.120697 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:19.121221 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:19.121339 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:19.125871 (+ 4532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:19.125888 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:19.125906 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:19.125944 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:19.129014 (+ 3070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:19.129706 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:19.129713 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:19.129715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:19.129880 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:19.130306 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:19.130310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:19.130312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:19.130738 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:19.130963 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:19.131221 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 06:55:19.131412 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":362,"threads_started":1}
W20260807 06:55:19.132325 14223 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40628
W20260807 06:55:19.132915 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 14018: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 06:55:19.133049 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 14018
I20260807 06:55:19.170081 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 14240
Aug 07 06:55:19 dist-test-slave-tfpf krb5kdc[13608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085716, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:55:19.185969 14706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:19.170918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60574 (local address 127.10.191.131:40691)
0807 06:55:19.171518 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:19.171522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:19.171536 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:55:19.171590 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:19.171594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:19.171647 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:19.171768 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:19.173125 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:19.173824 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:19.175068 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:19.175446 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:19.175577 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:19.180223 (+ 4646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:19.180241 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:19.180260 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:19.180308 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:19.183254 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:19.183932 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:19.183939 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:19.183941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:19.184084 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:19.184453 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:19.184456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:19.184458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:19.184832 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:19.185108 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:19.185397 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 06:55:19.185578 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":321,"threads_started":1}
W20260807 06:55:19.186721 14430 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60574
W20260807 06:55:19.187376 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 14240: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 06:55:19.187532 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 14240
I20260807 06:55:19.214560 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 13629
I20260807 06:55:19.215859 13738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:19.335027 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 13629
2026-08-07T06:55:19Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9104 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:19 dist-test-slave-tfpf krb5kdc[14712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:19 dist-test-slave-tfpf krb5kdc[14712](info): set up 2 sockets
Aug 07 06:55:19 dist-test-slave-tfpf krb5kdc[14712](info): commencing operation
krb5kdc: starting...
W20260807 06:55:20.620079 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:20 dist-test-slave-tfpf krb5kdc[14712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:55:20.880475 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:40603
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:40603
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:21.237090 14729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:21.237426 14729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:21.237622 14729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:21.245024 14729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:21.245179 14729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:21.245281 14729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:21.245389 14729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:21.245443 14729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:21.255762 14729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:40603
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:40603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:21.257215 14729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:21.258587 14729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:21.271452 14738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:21.271416 14740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:21.271528 14737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:21.277477 14729 server_base.cc:1034] running on GCE node
I20260807 06:55:21.278388 14729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:21.279930 14729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:21.281196 14729 hybrid_clock.cc:648] HybridClock initialized: now 1786085721281139 us; error 47 us; skew 500 ppm
I20260807 06:55:21.281611 14729 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:21 dist-test-slave-tfpf krb5kdc[14712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085721, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:21.284983 14729 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:55:21.286796 14729 webserver.cc:460] Webserver started at http://127.10.191.190:45843/ using document root <none> and password file <none>
I20260807 06:55:21.287606 14729 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:21.287770 14729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:21.288129 14729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:21.291419 14729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "bd2eb600301b47c1af75c98a1c24e431"
format_stamp: "Formatted at 2026-08-07 06:55:21 on dist-test-slave-tfpf"
server_key: "4d7b3dfb81dd2134b6fd2e9482da0779"
server_key_iv: "996da4eba2705b8d11ba64e6757129fd"
server_key_version: "encryptionkey@0"
I20260807 06:55:21.292297 14729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "bd2eb600301b47c1af75c98a1c24e431"
format_stamp: "Formatted at 2026-08-07 06:55:21 on dist-test-slave-tfpf"
server_key: "4d7b3dfb81dd2134b6fd2e9482da0779"
server_key_iv: "996da4eba2705b8d11ba64e6757129fd"
server_key_version: "encryptionkey@0"
I20260807 06:55:21.298285 14729 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260807 06:55:21.302198 14749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:21.303673 14729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260807 06:55:21.303893 14729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "bd2eb600301b47c1af75c98a1c24e431"
format_stamp: "Formatted at 2026-08-07 06:55:21 on dist-test-slave-tfpf"
server_key: "4d7b3dfb81dd2134b6fd2e9482da0779"
server_key_iv: "996da4eba2705b8d11ba64e6757129fd"
server_key_version: "encryptionkey@0"
I20260807 06:55:21.304127 14729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:21.329509 14729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:21.333796 14729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:21.334121 14729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:21.354485 14729 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:40603
I20260807 06:55:21.354506 14833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:40603 every 8 connection(s)
I20260807 06:55:21.356145 14729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:21.358070 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 14729
I20260807 06:55:21.358342 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:21.359262 11006 external_mini_cluster.cc:1428] Setting key 675117d1abf70b1e9cd704bea8f02d53
I20260807 06:55:21.361685 14834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 06:55:21 dist-test-slave-tfpf krb5kdc[14712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:21.376600 14834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431: Bootstrap starting.
I20260807 06:55:21.381319 14834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:21.382742 14834 log.cc:824] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:21.385413 14837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:21.361526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58122 (local address 127.10.191.190:40603)
0807 06:55:21.362389 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:21.362401 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:21.362443 (+ 42us) server_negotiation.cc:407] Connection header received
0807 06:55:21.364200 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:21.364223 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:21.364629 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:21.364975 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:21.366996 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:21.368401 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:21.370285 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:21.370951 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:21.371093 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:21.376169 (+ 5076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:21.376184 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:21.376209 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:21.376263 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:21.380463 (+ 4200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:21.381274 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:21.381287 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:21.381297 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:21.381532 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:21.381927 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:21.381932 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:21.381935 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:21.382731 (+ 796us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:21.383049 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:21.383539 (+ 490us) server_negotiation.cc:299] Negotiation successful
0807 06:55:21.384040 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":406,"threads_started":1}
I20260807 06:55:21.386492 14834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431: No bootstrap required, opened a new log
I20260807 06:55:21.394661 14834 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd2eb600301b47c1af75c98a1c24e431" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40603 } }
I20260807 06:55:21.395329 14834 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:21.395459 14834 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd2eb600301b47c1af75c98a1c24e431, State: Initialized, Role: FOLLOWER
I20260807 06:55:21.396064 14834 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd2eb600301b47c1af75c98a1c24e431" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40603 } }
I20260807 06:55:21.396317 14834 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:21.396468 14834 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:21.396654 14834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:21.399085 14834 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd2eb600301b47c1af75c98a1c24e431" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40603 } }
I20260807 06:55:21.399734 14834 leader_election.cc:302] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd2eb600301b47c1af75c98a1c24e431; no voters:
I20260807 06:55:21.400375 14834 leader_election.cc:288] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:21.400534 14841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:21.401646 14841 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [term 1 LEADER]: Becoming Leader. State: Replica: bd2eb600301b47c1af75c98a1c24e431, State: Running, Role: LEADER
I20260807 06:55:21.402374 14841 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd2eb600301b47c1af75c98a1c24e431" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40603 } }
I20260807 06:55:21.403012 14834 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:21.405459 14843 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd2eb600301b47c1af75c98a1c24e431. Latest consensus state: current_term: 1 leader_uuid: "bd2eb600301b47c1af75c98a1c24e431" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd2eb600301b47c1af75c98a1c24e431" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40603 } } }
I20260807 06:55:21.405931 14843 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:21.406277 14842 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd2eb600301b47c1af75c98a1c24e431" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd2eb600301b47c1af75c98a1c24e431" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40603 } } }
I20260807 06:55:21.406659 14842 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:21.408964 14850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:21.414460 14850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:21.424588 14850 catalog_manager.cc:1347] Generated new cluster ID: 4c7169078942497ba4f784c29f1c4428
I20260807 06:55:21.424744 14850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:21.467479 14850 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:21.468899 14850 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:21.483979 14850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd2eb600301b47c1af75c98a1c24e431: Generated new TSK 0
I20260807 06:55:21.485116 14850 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:55:21.566919 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40603
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:21.978129 14870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:21.978490 14870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:21.978794 14870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:21.986554 14870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:21.986726 14870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:21.986918 14870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:21.997591 14870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:21.999015 14870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:22.000432 14870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:22.014364 14879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:22.014439 14884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:22.014390 14880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:22.015131 14870 server_base.cc:1034] running on GCE node
I20260807 06:55:22.015765 14870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:22.016774 14870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:22.018019 14870 hybrid_clock.cc:648] HybridClock initialized: now 1786085722017972 us; error 38 us; skew 500 ppm
I20260807 06:55:22.018352 14870 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:22 dist-test-slave-tfpf krb5kdc[14712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085722, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:22.021699 14870 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:55:22.023236 14870 webserver.cc:460] Webserver started at http://127.10.191.129:41135/ using document root <none> and password file <none>
I20260807 06:55:22.024005 14870 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:22.024163 14870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:22.024508 14870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:22.027810 14870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "aac4947443e04216963deb7f80f97189"
format_stamp: "Formatted at 2026-08-07 06:55:22 on dist-test-slave-tfpf"
server_key: "dc4ac9a36546efbff45a5a62376e4321"
server_key_iv: "316e2567621fad58e598322f89525ed6"
server_key_version: "encryptionkey@0"
I20260807 06:55:22.028697 14870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "aac4947443e04216963deb7f80f97189"
format_stamp: "Formatted at 2026-08-07 06:55:22 on dist-test-slave-tfpf"
server_key: "dc4ac9a36546efbff45a5a62376e4321"
server_key_iv: "316e2567621fad58e598322f89525ed6"
server_key_version: "encryptionkey@0"
I20260807 06:55:22.034384 14870 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 06:55:22.038314 14892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:22.039688 14870 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:55:22.039877 14870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "aac4947443e04216963deb7f80f97189"
format_stamp: "Formatted at 2026-08-07 06:55:22 on dist-test-slave-tfpf"
server_key: "dc4ac9a36546efbff45a5a62376e4321"
server_key_iv: "316e2567621fad58e598322f89525ed6"
server_key_version: "encryptionkey@0"
I20260807 06:55:22.040107 14870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:22.062947 14870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:22.067118 14870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:22.067449 14870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:22.068508 14870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:22.069972 14870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:22.070087 14870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:22.070251 14870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:22.070328 14870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:22.105312 14870 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:46353
I20260807 06:55:22.105407 15062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:46353 every 8 connection(s)
I20260807 06:55:22.106743 14870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:22.108093 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 14870
I20260807 06:55:22.108345 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:22.109272 11006 external_mini_cluster.cc:1428] Setting key f660e3894f6cc595de7070481d44690b
Aug 07 06:55:22 dist-test-slave-tfpf krb5kdc[14712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085722, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:22.131526 15066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:22.109977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:48107 (local address 127.10.191.190:40603)
0807 06:55:22.110492 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:22.110496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:22.111800 (+ 1304us) server_negotiation.cc:407] Connection header received
0807 06:55:22.114904 (+ 3104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:22.114908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:22.114980 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:22.115104 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:22.117558 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:22.118315 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:22.120877 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:22.121377 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:22.121484 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:22.125400 (+ 3916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:22.125406 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:22.125409 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:22.125443 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:22.128083 (+ 2640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:22.128888 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:22.128894 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:22.128897 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:22.129031 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:22.129545 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:22.129552 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:22.129560 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:22.129843 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:22.130011 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:22.130889 (+ 878us) server_negotiation.cc:299] Negotiation successful
0807 06:55:22.131135 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":251,"threads_started":1}
I20260807 06:55:22.132558 15067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:22.110664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:40603 (local address 127.10.191.129:48107)
0807 06:55:22.111603 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:22.111662 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:22.114546 (+ 2884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:22.115408 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:22.115423 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:22.116339 (+ 916us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:22.117335 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:22.117377 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:22.118492 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:22.118500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:22.120713 (+ 2213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:22.120732 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:22.121651 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:22.121685 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:22.121974 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:22.122740 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:22.122765 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:22.125135 (+ 2370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:22.128259 (+ 3124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:22.128269 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:22.128287 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:22.128746 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:22.129185 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:22.129189 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:22.129193 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:22.129402 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:22.129984 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:22.129992 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:22.130465 (+ 473us) client_negotiation.cc:769] Sending connection context
0807 06:55:22.130773 (+ 308us) client_negotiation.cc:240] Negotiation successful
0807 06:55:22.131358 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":322,"threads_started":1}
I20260807 06:55:22.134435 15063 heartbeater.cc:347] Connected to a master server at 127.10.191.190:40603
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
I20260807 06:55:22.134796 15063 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:22.135653 15063 heartbeater.cc:511] Master 127.10.191.190:40603 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
I20260807 06:55:22.138350 14779 ts_manager.cc:194] Registered new tserver with Master: aac4947443e04216963deb7f80f97189 (127.10.191.129:46353)
I20260807 06:55:22.140633 14779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:48107
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:55:22.166011 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40603
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:22.520893 15071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:22.521314 15071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:22.521520 15071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:22.528411 15071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:22.528584 15071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:22.528766 15071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:22.538991 15071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:22.540452 15071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:22.541929 15071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:22.555321 15080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:22.555371 15081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:22.555409 15083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:22.556432 15071 server_base.cc:1034] running on GCE node
I20260807 06:55:22.557165 15071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:22.558166 15071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:22.559393 15071 hybrid_clock.cc:648] HybridClock initialized: now 1786085722559331 us; error 59 us; skew 500 ppm
I20260807 06:55:22.559715 15071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:22 dist-test-slave-tfpf krb5kdc[14712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085722, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:22.563095 15071 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:55:22.564565 15071 webserver.cc:460] Webserver started at http://127.10.191.130:40003/ using document root <none> and password file <none>
I20260807 06:55:22.565376 15071 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:22.565532 15071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:22.565838 15071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:22.568809 15071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "45520b6be9104db2ae0b5bae13122fae"
format_stamp: "Formatted at 2026-08-07 06:55:22 on dist-test-slave-tfpf"
server_key: "a8f6da04a4ac2771946b6cb97a4006c2"
server_key_iv: "0cb03bbcfdd4f65d38ae14ac97c4e4e3"
server_key_version: "encryptionkey@0"
I20260807 06:55:22.569697 15071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "45520b6be9104db2ae0b5bae13122fae"
format_stamp: "Formatted at 2026-08-07 06:55:22 on dist-test-slave-tfpf"
server_key: "a8f6da04a4ac2771946b6cb97a4006c2"
server_key_iv: "0cb03bbcfdd4f65d38ae14ac97c4e4e3"
server_key_version: "encryptionkey@0"
I20260807 06:55:22.575363 15071 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:55:22.579252 15092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:22.580729 15071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:55:22.580933 15071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "45520b6be9104db2ae0b5bae13122fae"
format_stamp: "Formatted at 2026-08-07 06:55:22 on dist-test-slave-tfpf"
server_key: "a8f6da04a4ac2771946b6cb97a4006c2"
server_key_iv: "0cb03bbcfdd4f65d38ae14ac97c4e4e3"
server_key_version: "encryptionkey@0"
I20260807 06:55:22.581224 15071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:22.607306 15071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:22.612044 15071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:22.612378 15071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:22.613466 15071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:22.614900 15071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:22.615015 15071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:22.615181 15071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:22.615253 15071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:22.648922 15071 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:37809
I20260807 06:55:22.648976 15258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:37809 every 8 connection(s)
I20260807 06:55:22.650359 15071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:22.652983 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 15071
I20260807 06:55:22.653210 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:22.653792 11006 external_mini_cluster.cc:1428] Setting key 82dcf02e8e860d5bbe414693506a2ce8
Aug 07 06:55:22 dist-test-slave-tfpf krb5kdc[14712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085722, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:22.674521 15261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:22.653093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:45255 (local address 127.10.191.190:40603)
0807 06:55:22.653627 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:22.653635 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:22.655080 (+ 1445us) server_negotiation.cc:407] Connection header received
0807 06:55:22.657214 (+ 2134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:22.657222 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:22.657316 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:22.657435 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:22.659872 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:22.660981 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:22.663508 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:22.663915 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:22.664011 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:22.668405 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:22.668411 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:22.668414 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:22.668457 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:22.671216 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:22.672041 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:22.672045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:22.672047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:22.672190 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:22.672664 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:22.672668 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:22.672670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:22.672980 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:22.673160 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:22.673923 (+ 763us) server_negotiation.cc:299] Negotiation successful
0807 06:55:22.674151 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":249,"threads_started":1}
I20260807 06:55:22.675585 15262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:22.653745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:40603 (local address 127.10.191.130:45255)
0807 06:55:22.654627 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:22.654687 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:22.656824 (+ 2137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:22.657817 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:22.657833 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:22.658722 (+ 889us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:22.659639 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:22.659670 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:22.661208 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:22.661216 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:22.663337 (+ 2121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:22.663356 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:22.664155 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:22.664164 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:22.664481 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:22.665393 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:22.665432 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:22.668105 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:22.671390 (+ 3285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:22.671400 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:22.671421 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:22.671894 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:22.672308 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:22.672314 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:22.672317 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:22.672528 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:22.673153 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:22.673161 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:22.673523 (+ 362us) client_negotiation.cc:769] Sending connection context
0807 06:55:22.673820 (+ 297us) client_negotiation.cc:240] Negotiation successful
0807 06:55:22.674378 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":362,"threads_started":1}
I20260807 06:55:22.677174 15259 heartbeater.cc:347] Connected to a master server at 127.10.191.190:40603
I20260807 06:55:22.677568 15259 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:22.678534 15259 heartbeater.cc:511] Master 127.10.191.190:40603 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
I20260807 06:55:22.680442 14779 ts_manager.cc:194] Registered new tserver with Master: 45520b6be9104db2ae0b5bae13122fae (127.10.191.130:37809)
I20260807 06:55:22.681427 14779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:45255
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:55:22.708837 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40603
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:23.046833 15267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:23.047147 15267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:23.047241 15267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:23.054539 15267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:23.054678 15267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:23.054795 15267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:23.064631 15267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40603
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:23.065933 15267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:23.067250 15267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:23.080475 15272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:23.080466 15276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:23.080523 15273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:23.081615 15267 server_base.cc:1034] running on GCE node
I20260807 06:55:23.082238 15267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:23.083284 15267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:23.084568 15267 hybrid_clock.cc:648] HybridClock initialized: now 1786085723084485 us; error 50 us; skew 500 ppm
I20260807 06:55:23.084890 15267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:23 dist-test-slave-tfpf krb5kdc[14712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085723, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:23.088188 15267 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:55:23.089638 15267 webserver.cc:460] Webserver started at http://127.10.191.131:42581/ using document root <none> and password file <none>
I20260807 06:55:23.090483 15267 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:23.090600 15267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:23.090879 15267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:23.093871 15267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "88d263a9f184491d86b348770e39d31a"
format_stamp: "Formatted at 2026-08-07 06:55:23 on dist-test-slave-tfpf"
server_key: "65262dc380b0f4fa8a44fe3f7845f013"
server_key_iv: "be19e56ed8237429e836184b4cb77fd4"
server_key_version: "encryptionkey@0"
I20260807 06:55:23.094609 15267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "88d263a9f184491d86b348770e39d31a"
format_stamp: "Formatted at 2026-08-07 06:55:23 on dist-test-slave-tfpf"
server_key: "65262dc380b0f4fa8a44fe3f7845f013"
server_key_iv: "be19e56ed8237429e836184b4cb77fd4"
server_key_version: "encryptionkey@0"
I20260807 06:55:23.100077 15267 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:55:23.103914 15294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:23.105515 15267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:23.105684 15267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "88d263a9f184491d86b348770e39d31a"
format_stamp: "Formatted at 2026-08-07 06:55:23 on dist-test-slave-tfpf"
server_key: "65262dc380b0f4fa8a44fe3f7845f013"
server_key_iv: "be19e56ed8237429e836184b4cb77fd4"
server_key_version: "encryptionkey@0"
I20260807 06:55:23.105914 15267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:23.130597 15267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:23.135062 15267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:23.135380 15267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:23.136387 15267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:23.137912 15267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:23.137991 15267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:23.138154 15267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:23.138204 15267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:23.144886 15063 heartbeater.cc:503] Master 127.10.191.190:40603 was elected leader, sending a full tablet report...
I20260807 06:55:23.171705 15267 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:34707
I20260807 06:55:23.171751 15460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:34707 every 8 connection(s)
I20260807 06:55:23.173092 15267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:23.174659 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 15267
I20260807 06:55:23.174885 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:23.175451 11006 external_mini_cluster.cc:1428] Setting key 4f0c07e9aa9aded0a06ed415526fda39
Aug 07 06:55:23 dist-test-slave-tfpf krb5kdc[14712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085723, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:23.195055 15464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:23.176197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:51281 (local address 127.10.191.190:40603)
0807 06:55:23.176693 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:23.176699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:23.178127 (+ 1428us) server_negotiation.cc:407] Connection header received
0807 06:55:23.180286 (+ 2159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:23.180290 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:23.180359 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:23.180465 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:23.182135 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:23.182957 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:23.184541 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:23.185139 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:23.185266 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:23.188711 (+ 3445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:23.188716 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:23.188719 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:23.188753 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:23.192143 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:23.192830 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:23.192834 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:23.192836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:23.192966 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:23.193502 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:23.193506 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:23.193508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:23.193787 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:23.193906 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:23.194601 (+ 695us) server_negotiation.cc:299] Negotiation successful
0807 06:55:23.194773 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":243,"threads_started":1}
I20260807 06:55:23.196007 15466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:23.176929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:40603 (local address 127.10.191.131:51281)
0807 06:55:23.177925 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:23.177989 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:23.180034 (+ 2045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:23.180689 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:23.180697 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:23.181339 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:23.181948 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:23.181967 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:23.183112 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:23.183115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:23.184390 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:23.184403 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:23.185371 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:23.185377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:23.185564 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:23.186286 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:23.186307 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:23.188489 (+ 2182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:23.192277 (+ 3788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:23.192285 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:23.192298 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:23.192727 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:23.193118 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:23.193126 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:23.193131 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:23.193386 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:23.193904 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:23.193910 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:23.194237 (+ 327us) client_negotiation.cc:769] Sending connection context
0807 06:55:23.194468 (+ 231us) client_negotiation.cc:240] Negotiation successful
0807 06:55:23.194878 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":384,"threads_started":1}
I20260807 06:55:23.197481 15461 heartbeater.cc:347] Connected to a master server at 127.10.191.190:40603
I20260807 06:55:23.197924 15461 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:23.198659 15461 heartbeater.cc:511] Master 127.10.191.190:40603 requested a full tablet report, sending...
I20260807 06:55:23.200214 14779 ts_manager.cc:194] Registered new tserver with Master: 88d263a9f184491d86b348770e39d31a (127.10.191.131:34707)
I20260807 06:55:23.201176 14779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:51281
I20260807 06:55:23.204547 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 06:55:23.247529 15464 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:55:23.244788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58136 (local address 127.10.191.190:40603)
0807 06:55:23.245046 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:23.245056 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:23.245453 (+ 397us) server_negotiation.cc:407] Connection header received
0807 06:55:23.245681 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:23.245685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:23.245765 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:23.245877 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:23.247209 (+ 1332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58136: BlockingRecv error: recv got EOF from 127.0.0.1:58136 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 06:55:23.250598 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 14870
W20260807 06:55:23.253563 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 14870: Not authorized: Client connection negotiation failed: client connection to 127.10.191.129:46353: server requires authentication, but client does not have Kerberos credentials available
I20260807 06:55:23.253777 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 14870
I20260807 06:55:23.279157 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 15071
W20260807 06:55:23.282295 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 15071: Not authorized: Client connection negotiation failed: client connection to 127.10.191.130:37809: server requires authentication, but client does not have Kerberos credentials available
I20260807 06:55:23.282485 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 15071
I20260807 06:55:23.310222 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 15267
W20260807 06:55:23.313197 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 15267: Not authorized: Client connection negotiation failed: client connection to 127.10.191.131:34707: server requires authentication, but client does not have Kerberos credentials available
I20260807 06:55:23.313367 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 15267
I20260807 06:55:23.340469 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 14729
I20260807 06:55:23.341881 14827 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:23.445128 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 14729
2026-08-07T06:55:23Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4108 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:23 dist-test-slave-tfpf krb5kdc[15496](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:23 dist-test-slave-tfpf krb5kdc[15496](info): set up 2 sockets
Aug 07 06:55:23 dist-test-slave-tfpf krb5kdc[15496](info): commencing operation
krb5kdc: starting...
W20260807 06:55:24.683110 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:24 dist-test-slave-tfpf krb5kdc[15496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:55:24.926837 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36983
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:37875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:36983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:25.288012 15516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:25.288440 15516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:25.288626 15516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:25.296408 15516 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:25.296595 15516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:25.296730 15516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:25.296835 15516 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:25.296929 15516 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:25.307381 15516 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:37875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:36983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:25.308840 15516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:25.310238 15516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:25.322554 15529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:25.322678 15525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:25.322700 15526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:25.324193 15516 server_base.cc:1034] running on GCE node
I20260807 06:55:25.325026 15516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:25.326581 15516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:25.327792 15516 hybrid_clock.cc:648] HybridClock initialized: now 1786085725327750 us; error 36 us; skew 500 ppm
I20260807 06:55:25.328191 15516 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:25 dist-test-slave-tfpf krb5kdc[15496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085725, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:25.335209 15516 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:55:25.336964 15516 webserver.cc:460] Webserver started at http://127.10.191.190:39933/ using document root <none> and password file <none>
I20260807 06:55:25.337781 15516 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:25.337953 15516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:25.338292 15516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:25.341638 15516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "33f4dc5ffd3544979fe948ced493c3ab"
format_stamp: "Formatted at 2026-08-07 06:55:25 on dist-test-slave-tfpf"
server_key: "c04d959656449ee216fe7c873902f506"
server_key_iv: "dbb2f2af64ddace845e168f5ca1a5e27"
server_key_version: "encryptionkey@0"
I20260807 06:55:25.342485 15516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "33f4dc5ffd3544979fe948ced493c3ab"
format_stamp: "Formatted at 2026-08-07 06:55:25 on dist-test-slave-tfpf"
server_key: "c04d959656449ee216fe7c873902f506"
server_key_iv: "dbb2f2af64ddace845e168f5ca1a5e27"
server_key_version: "encryptionkey@0"
I20260807 06:55:25.348071 15516 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:55:25.351714 15537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:25.353223 15516 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:25.353420 15516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "33f4dc5ffd3544979fe948ced493c3ab"
format_stamp: "Formatted at 2026-08-07 06:55:25 on dist-test-slave-tfpf"
server_key: "c04d959656449ee216fe7c873902f506"
server_key_iv: "dbb2f2af64ddace845e168f5ca1a5e27"
server_key_version: "encryptionkey@0"
I20260807 06:55:25.353649 15516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:25.383551 15516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:25.387856 15516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:25.388173 15516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:25.408437 15516 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:36983
I20260807 06:55:25.408471 15604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:36983 every 8 connection(s)
I20260807 06:55:25.409912 15516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:25.413967 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 15516
I20260807 06:55:25.414244 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:25.414247 15605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:25.414917 11006 external_mini_cluster.cc:1428] Setting key ea67bfbc7c6eb4c83cd456ad1328df2c
I20260807 06:55:25.429665 15605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab: Bootstrap starting.
Aug 07 06:55:25 dist-test-slave-tfpf krb5kdc[15496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:25.434010 15605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:25.435387 15605 log.cc:824] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:25.439137 15605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab: No bootstrap required, opened a new log
I20260807 06:55:25.440142 15612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:25.416877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57310 (local address 127.10.191.190:36983)
0807 06:55:25.417889 (+ 1012us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:25.417900 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:25.417963 (+ 63us) server_negotiation.cc:407] Connection header received
0807 06:55:25.419519 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:25.419542 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:25.419948 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:25.420320 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:25.422347 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:25.423587 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:25.425228 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:25.425977 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:25.426115 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:25.431061 (+ 4946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:25.431074 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:25.431094 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:25.431148 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:25.435147 (+ 3999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:25.436051 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:25.436062 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:25.436073 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:25.436280 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:25.436736 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:25.436739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:25.436741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:25.437530 (+ 789us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:25.437823 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:25.438247 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 06:55:25.438693 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":780,"thread_start_us":530,"threads_started":1}
I20260807 06:55:25.444298 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:55:25.447790 15605 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f4dc5ffd3544979fe948ced493c3ab" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36983 } }
I20260807 06:55:25.448228 15605 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:25.448354 15605 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f4dc5ffd3544979fe948ced493c3ab, State: Initialized, Role: FOLLOWER
I20260807 06:55:25.448956 15605 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f4dc5ffd3544979fe948ced493c3ab" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36983 } }
I20260807 06:55:25.449287 15605 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:25.449443 15605 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:25.449649 15605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:25.451968 15605 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f4dc5ffd3544979fe948ced493c3ab" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36983 } }
I20260807 06:55:25.452564 15605 leader_election.cc:302] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33f4dc5ffd3544979fe948ced493c3ab; no voters:
I20260807 06:55:25.453240 15605 leader_election.cc:288] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:25.453404 15614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:25.454617 15614 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [term 1 LEADER]: Becoming Leader. State: Replica: 33f4dc5ffd3544979fe948ced493c3ab, State: Running, Role: LEADER
I20260807 06:55:25.455323 15614 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f4dc5ffd3544979fe948ced493c3ab" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36983 } }
I20260807 06:55:25.455665 15605 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:25.461815 15616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33f4dc5ffd3544979fe948ced493c3ab. Latest consensus state: current_term: 1 leader_uuid: "33f4dc5ffd3544979fe948ced493c3ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f4dc5ffd3544979fe948ced493c3ab" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36983 } } }
I20260807 06:55:25.462236 15616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:25.462836 15615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33f4dc5ffd3544979fe948ced493c3ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f4dc5ffd3544979fe948ced493c3ab" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36983 } } }
I20260807 06:55:25.463122 15615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab [sys.catalog]: This master's current role is: LEADER
W20260807 06:55:25.473119 15636 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:55:25.473364 15636 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:55:25.473573 15631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:25.476080 15631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:25.485618 15631 catalog_manager.cc:1347] Generated new cluster ID: 970c87d5fa9e475b90f02f7edbb84a7a
I20260807 06:55:25.485741 15631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:25.503161 15631 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:25.504419 15631 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:25.504957 15612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:25.496278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57322 (local address 127.10.191.190:36983)
0807 06:55:25.496541 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:25.496550 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:25.497262 (+ 712us) server_negotiation.cc:407] Connection header received
0807 06:55:25.497522 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:25.497527 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:25.497595 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:25.497714 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:25.498872 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:25.499610 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:25.500992 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:25.501736 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:25.501900 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:25.503096 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:25.503102 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:25.503106 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:25.504006 (+ 900us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:25.504069 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:25.504097 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:25.504186 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:25.504450 (+ 264us) server_negotiation.cc:299] Negotiation successful
0807 06:55:25.504623 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260807 06:55:25.510848 15631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33f4dc5ffd3544979fe948ced493c3ab: Generated new TSK 0
I20260807 06:55:25.511729 15631 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:55:25.519724 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 15516
I20260807 06:55:25.520972 15597 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:25.611763 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 15516
2026-08-07T06:55:25Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2161 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:25 dist-test-slave-tfpf krb5kdc[15653](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:25 dist-test-slave-tfpf krb5kdc[15653](info): set up 2 sockets
Aug 07 06:55:25 dist-test-slave-tfpf krb5kdc[15653](info): commencing operation
krb5kdc: starting...
W20260807 06:55:26.877377 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.002s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:27 dist-test-slave-tfpf krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:55:27.125969 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35213
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:35213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:27.473448 15686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:27.473759 15686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:27.473937 15686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:27.480934 15686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:27.481117 15686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:27.481238 15686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:27.481340 15686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:27.481428 15686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:27.491015 15686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:35213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:27.492501 15686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:27.493852 15686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:27.506141 15694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:27.506075 15695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:27.506038 15698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:27.507364 15686 server_base.cc:1034] running on GCE node
I20260807 06:55:27.508224 15686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:27.509863 15686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:27.511114 15686 hybrid_clock.cc:648] HybridClock initialized: now 1786085727511068 us; error 36 us; skew 500 ppm
I20260807 06:55:27.511500 15686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:27 dist-test-slave-tfpf krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085727, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:27.514649 15686 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:55:27.516088 15686 webserver.cc:460] Webserver started at http://127.10.191.190:43743/ using document root <none> and password file <none>
I20260807 06:55:27.516813 15686 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:27.516963 15686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:27.517369 15686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:27.520347 15686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "cfb12f86d9b246788026ee4000737648"
format_stamp: "Formatted at 2026-08-07 06:55:27 on dist-test-slave-tfpf"
server_key: "47027b00b13dece149fc15dc315e3a9e"
server_key_iv: "83212db4b85fbf414e337953d10212ab"
server_key_version: "encryptionkey@0"
I20260807 06:55:27.521235 15686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "cfb12f86d9b246788026ee4000737648"
format_stamp: "Formatted at 2026-08-07 06:55:27 on dist-test-slave-tfpf"
server_key: "47027b00b13dece149fc15dc315e3a9e"
server_key_iv: "83212db4b85fbf414e337953d10212ab"
server_key_version: "encryptionkey@0"
I20260807 06:55:27.526502 15686 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260807 06:55:27.530048 15708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:27.531356 15686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:55:27.531551 15686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "cfb12f86d9b246788026ee4000737648"
format_stamp: "Formatted at 2026-08-07 06:55:27 on dist-test-slave-tfpf"
server_key: "47027b00b13dece149fc15dc315e3a9e"
server_key_iv: "83212db4b85fbf414e337953d10212ab"
server_key_version: "encryptionkey@0"
I20260807 06:55:27.531778 15686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:27.568701 15686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:27.573204 15686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:27.573527 15686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:27.592900 15686 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:35213
I20260807 06:55:27.592924 15776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:35213 every 8 connection(s)
I20260807 06:55:27.594391 15686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:27.598495 15778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:27.603662 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 15686
I20260807 06:55:27.603864 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:27.604485 11006 external_mini_cluster.cc:1428] Setting key 6d28512a9b17c6cb63d63ff61b7410b4
I20260807 06:55:27.609736 15778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648: Bootstrap starting.
I20260807 06:55:27.613916 15778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:27.615233 15778 log.cc:824] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:27.618475 15778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648: No bootstrap required, opened a new log
Aug 07 06:55:27 dist-test-slave-tfpf krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:27.629547 15778 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfb12f86d9b246788026ee4000737648" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35213 } }
I20260807 06:55:27.629899 15784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:27.606725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54484 (local address 127.10.191.190:35213)
0807 06:55:27.607616 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:27.607631 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:27.607679 (+ 48us) server_negotiation.cc:407] Connection header received
0807 06:55:27.609352 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:27.609379 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:27.609748 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:27.610146 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:27.612040 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:27.613373 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:27.615145 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:27.616016 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:27.616242 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:27.620280 (+ 4038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:27.620294 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:27.620321 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:27.620379 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:27.624839 (+ 4460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:27.625731 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:27.625741 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:27.625752 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:27.625985 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:27.626368 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:27.626373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:27.626377 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:27.627189 (+ 812us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:27.627516 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:27.627855 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 06:55:27.628371 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":441,"threads_started":1}
I20260807 06:55:27.630079 15778 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:27.630190 15778 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfb12f86d9b246788026ee4000737648, State: Initialized, Role: FOLLOWER
I20260807 06:55:27.630896 15778 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfb12f86d9b246788026ee4000737648" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35213 } }
I20260807 06:55:27.631197 15778 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:27.631366 15778 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:27.631590 15778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:27.634264 15778 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfb12f86d9b246788026ee4000737648" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35213 } }
I20260807 06:55:27.634773 15778 leader_election.cc:302] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfb12f86d9b246788026ee4000737648; no voters:
I20260807 06:55:27.635432 15778 leader_election.cc:288] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:27.635583 15786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:27.636288 15786 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [term 1 LEADER]: Becoming Leader. State: Replica: cfb12f86d9b246788026ee4000737648, State: Running, Role: LEADER
I20260807 06:55:27.636890 15786 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfb12f86d9b246788026ee4000737648" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35213 } }
I20260807 06:55:27.637703 15778 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:27.639655 15789 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfb12f86d9b246788026ee4000737648. Latest consensus state: current_term: 1 leader_uuid: "cfb12f86d9b246788026ee4000737648" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfb12f86d9b246788026ee4000737648" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35213 } } }
I20260807 06:55:27.640079 15789 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:27.640661 15788 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfb12f86d9b246788026ee4000737648" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfb12f86d9b246788026ee4000737648" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35213 } } }
I20260807 06:55:27.641158 15788 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:27.644688 15795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:27.650382 15795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:27.659463 15795 catalog_manager.cc:1347] Generated new cluster ID: 71633727e00342828647665edb5b0ed7
I20260807 06:55:27.659615 15795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:27.672001 15795 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:27.673417 15795 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:27.693203 15795 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfb12f86d9b246788026ee4000737648: Generated new TSK 0
I20260807 06:55:27.694118 15795 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:55:27.757979 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35213
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:28.124056 15821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:28.124384 15821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:28.124569 15821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:28.132292 15821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:28.132500 15821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:28.132678 15821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:28.143081 15821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35213
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:28.144381 15821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:28.145856 15821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:28.159744 15828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:28.159744 15829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:28.160000 15835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:28.160561 15821 server_base.cc:1034] running on GCE node
I20260807 06:55:28.161417 15821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:28.162475 15821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:28.163722 15821 hybrid_clock.cc:648] HybridClock initialized: now 1786085728163657 us; error 59 us; skew 500 ppm
I20260807 06:55:28.164064 15821 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:28 dist-test-slave-tfpf krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085728, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:28.167428 15821 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:55:28.168905 15821 webserver.cc:460] Webserver started at http://127.10.191.129:36023/ using document root <none> and password file <none>
I20260807 06:55:28.169680 15821 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:28.169829 15821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:28.170148 15821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:28.173344 15821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "51b680b66c964312a3f5a1ddb269b3a4"
format_stamp: "Formatted at 2026-08-07 06:55:28 on dist-test-slave-tfpf"
server_key: "e44ecb8becc18edfb36b660f077a2c0b"
server_key_iv: "566847687020a8277252178c28d7a433"
server_key_version: "encryptionkey@0"
I20260807 06:55:28.174186 15821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "51b680b66c964312a3f5a1ddb269b3a4"
format_stamp: "Formatted at 2026-08-07 06:55:28 on dist-test-slave-tfpf"
server_key: "e44ecb8becc18edfb36b660f077a2c0b"
server_key_iv: "566847687020a8277252178c28d7a433"
server_key_version: "encryptionkey@0"
I20260807 06:55:28.179481 15821 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:55:28.183055 15847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:28.184332 15821 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:55:28.184517 15821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "51b680b66c964312a3f5a1ddb269b3a4"
format_stamp: "Formatted at 2026-08-07 06:55:28 on dist-test-slave-tfpf"
server_key: "e44ecb8becc18edfb36b660f077a2c0b"
server_key_iv: "566847687020a8277252178c28d7a433"
server_key_version: "encryptionkey@0"
I20260807 06:55:28.184743 15821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:28.206310 15821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:28.210508 15821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:28.210819 15821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:28.211894 15821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:28.213433 15821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:28.213543 15821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:28.213697 15821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:28.213768 15821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:28.248318 15821 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:42499
I20260807 06:55:28.248368 16007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:42499 every 8 connection(s)
I20260807 06:55:28.249765 15821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:28.257257 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 15821
I20260807 06:55:28.257498 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:28.258257 11006 external_mini_cluster.cc:1428] Setting key ce64e1a1c6eba4f599414c252d500621
Aug 07 06:55:28 dist-test-slave-tfpf krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085728, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:28.273269 16010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:28.252530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:49293 (local address 127.10.191.190:35213)
0807 06:55:28.253028 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:28.253032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:28.254132 (+ 1100us) server_negotiation.cc:407] Connection header received
0807 06:55:28.256147 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:28.256153 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:28.256294 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:28.256416 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:28.258635 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:28.259519 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:28.261409 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:28.262150 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:28.262312 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:28.266048 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:28.266057 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:28.266065 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:28.266118 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:28.269728 (+ 3610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:28.270534 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:28.270543 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:28.270550 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:28.270728 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:28.271287 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:28.271290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:28.271292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:28.271577 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:28.271706 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:28.272726 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0807 06:55:28.272911 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":238,"threads_started":1}
I20260807 06:55:28.274811 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:28.253230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35213 (local address 127.10.191.129:49293)
0807 06:55:28.253955 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:28.254003 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:28.255759 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:28.256759 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:28.256774 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:28.257701 (+ 927us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:28.258441 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:28.258463 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:28.259719 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:28.259723 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:28.261243 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:28.261257 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:28.262390 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:28.262394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:28.262595 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:28.263340 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:28.263368 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:28.265760 (+ 2392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:28.269906 (+ 4146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:28.269915 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:28.269930 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:28.270389 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:28.270846 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:28.270852 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:28.270857 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:28.271160 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:28.271714 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:28.271726 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:28.272292 (+ 566us) client_negotiation.cc:769] Sending connection context
0807 06:55:28.272624 (+ 332us) client_negotiation.cc:240] Negotiation successful
0807 06:55:28.273288 (+ 664us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":277,"threads_started":1}
I20260807 06:55:28.276512 16008 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35213
I20260807 06:55:28.277027 16008 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:28.278038 16008 heartbeater.cc:511] Master 127.10.191.190:35213 requested a full tablet report, sending...
I20260807 06:55:28.280397 15732 ts_manager.cc:194] Registered new tserver with Master: 51b680b66c964312a3f5a1ddb269b3a4 (127.10.191.129:42499)
I20260807 06:55:28.282153 15732 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:49293
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:55:28.316605 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35213
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:28.664415 16017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:28.664804 16017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:28.665004 16017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:28.672451 16017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:28.672624 16017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:28.672809 16017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:28.684284 16017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35213
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:28.685904 16017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:28.687351 16017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:28.702044 16026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:28.702158 16029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:28.702104 16024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:28.702946 16017 server_base.cc:1034] running on GCE node
I20260807 06:55:28.703648 16017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:28.704648 16017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:28.705904 16017 hybrid_clock.cc:648] HybridClock initialized: now 1786085728705855 us; error 54 us; skew 500 ppm
I20260807 06:55:28.706260 16017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:28 dist-test-slave-tfpf krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085728, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:28.709635 16017 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:55:28.711264 16017 webserver.cc:460] Webserver started at http://127.10.191.130:46621/ using document root <none> and password file <none>
I20260807 06:55:28.712038 16017 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:28.712215 16017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:28.712545 16017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:28.715662 16017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "83c0332abb9a4c6f9b1af0a6424fe714"
format_stamp: "Formatted at 2026-08-07 06:55:28 on dist-test-slave-tfpf"
server_key: "c0ef93dcbdcea59cc1e8dda3c424ff3d"
server_key_iv: "851125001ad9e247f15deeaab4b47c82"
server_key_version: "encryptionkey@0"
I20260807 06:55:28.716549 16017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "83c0332abb9a4c6f9b1af0a6424fe714"
format_stamp: "Formatted at 2026-08-07 06:55:28 on dist-test-slave-tfpf"
server_key: "c0ef93dcbdcea59cc1e8dda3c424ff3d"
server_key_iv: "851125001ad9e247f15deeaab4b47c82"
server_key_version: "encryptionkey@0"
I20260807 06:55:28.722355 16017 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 06:55:28.726155 16039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:28.727591 16017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:55:28.727777 16017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "83c0332abb9a4c6f9b1af0a6424fe714"
format_stamp: "Formatted at 2026-08-07 06:55:28 on dist-test-slave-tfpf"
server_key: "c0ef93dcbdcea59cc1e8dda3c424ff3d"
server_key_iv: "851125001ad9e247f15deeaab4b47c82"
server_key_version: "encryptionkey@0"
I20260807 06:55:28.727983 16017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:28.750785 16017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:28.755627 16017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:28.755967 16017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:28.757038 16017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:28.758496 16017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:28.758616 16017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:28.758766 16017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:28.758837 16017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:28.800364 16017 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:46839
I20260807 06:55:28.800414 16201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:46839 every 8 connection(s)
I20260807 06:55:28.801916 16017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:28.804116 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 16017
I20260807 06:55:28.804322 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:28.804839 11006 external_mini_cluster.cc:1428] Setting key eac5b9f697e48fb6ebc2f789ee0ed517
Aug 07 06:55:28 dist-test-slave-tfpf krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085728, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:28.824721 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:28.804651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:58321 (local address 127.10.191.190:35213)
0807 06:55:28.805199 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:28.805206 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:28.806407 (+ 1201us) server_negotiation.cc:407] Connection header received
0807 06:55:28.808367 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:28.808373 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:28.808476 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:28.808604 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:28.810556 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:28.811592 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:28.813816 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:28.814432 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:28.814550 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:28.818898 (+ 4348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:28.818903 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:28.818906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:28.818940 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:28.821585 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:28.822380 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:28.822385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:28.822387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:28.822526 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:28.822963 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:28.822966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:28.822968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:28.823242 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:28.823394 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:28.824115 (+ 721us) server_negotiation.cc:299] Negotiation successful
0807 06:55:28.824337 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":251,"threads_started":1}
I20260807 06:55:28.825753 16208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:28.805337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35213 (local address 127.10.191.130:58321)
0807 06:55:28.806248 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:28.806292 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:28.808099 (+ 1807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:28.808844 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:28.808853 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:28.809639 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:28.810373 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:28.810399 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:28.811764 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:28.811772 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:28.813644 (+ 1872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:28.813661 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:28.814822 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:28.814829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:28.815111 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:28.815843 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:28.815875 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:28.818622 (+ 2747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:28.821745 (+ 3123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:28.821755 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:28.821773 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:28.822246 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:28.822639 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:28.822644 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:28.822647 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:28.822841 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:28.823371 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:28.823379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:28.823738 (+ 359us) client_negotiation.cc:769] Sending connection context
0807 06:55:28.824003 (+ 265us) client_negotiation.cc:240] Negotiation successful
0807 06:55:28.824545 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":365,"threads_started":1}
I20260807 06:55:28.827418 16203 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35213
I20260807 06:55:28.827795 16203 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:28.828745 16203 heartbeater.cc:511] Master 127.10.191.190:35213 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
I20260807 06:55:28.830345 15732 ts_manager.cc:194] Registered new tserver with Master: 83c0332abb9a4c6f9b1af0a6424fe714 (127.10.191.130:46839)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
I20260807 06:55:28.831270 15732 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:58321
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:55:28.860205 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35213
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:29.202852 16211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:29.203219 16211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:29.203401 16211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:29.210304 16211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:29.210505 16211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:29.210721 16211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:29.220633 16211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35213
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:29.222102 16211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:29.223528 16211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:29.237391 16218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:29.237428 16220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:29.237512 16223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:29.238250 16211 server_base.cc:1034] running on GCE node
I20260807 06:55:29.238977 16211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:29.239962 16211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:29.241183 16211 hybrid_clock.cc:648] HybridClock initialized: now 1786085729241123 us; error 46 us; skew 500 ppm
I20260807 06:55:29.241520 16211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085729, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:29.244747 16211 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:55:29.246372 16211 webserver.cc:460] Webserver started at http://127.10.191.131:42305/ using document root <none> and password file <none>
I20260807 06:55:29.247107 16211 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:29.247217 16211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:29.247498 16211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:29.250502 16211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "b2c0c1c98cb64234ae922e60be3838c3"
format_stamp: "Formatted at 2026-08-07 06:55:29 on dist-test-slave-tfpf"
server_key: "b7b265c12ee5f69787e3a8655f16842e"
server_key_iv: "25b31141b529d64dbc547c8c4e565186"
server_key_version: "encryptionkey@0"
I20260807 06:55:29.251338 16211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "b2c0c1c98cb64234ae922e60be3838c3"
format_stamp: "Formatted at 2026-08-07 06:55:29 on dist-test-slave-tfpf"
server_key: "b7b265c12ee5f69787e3a8655f16842e"
server_key_iv: "25b31141b529d64dbc547c8c4e565186"
server_key_version: "encryptionkey@0"
I20260807 06:55:29.256374 16211 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260807 06:55:29.260088 16238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:29.261536 16211 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:29.261729 16211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "b2c0c1c98cb64234ae922e60be3838c3"
format_stamp: "Formatted at 2026-08-07 06:55:29 on dist-test-slave-tfpf"
server_key: "b7b265c12ee5f69787e3a8655f16842e"
server_key_iv: "25b31141b529d64dbc547c8c4e565186"
server_key_version: "encryptionkey@0"
I20260807 06:55:29.261951 16211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:29.285645 16008 heartbeater.cc:503] Master 127.10.191.190:35213 was elected leader, sending a full tablet report...
I20260807 06:55:29.310798 16211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:29.315169 16211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:29.315495 16211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:29.316636 16211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:29.318203 16211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:29.318331 16211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:29.318488 16211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:29.318559 16211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:29.354671 16211 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:36825
I20260807 06:55:29.354728 16419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:36825 every 8 connection(s)
I20260807 06:55:29.356020 16211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:29.357283 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 16211
I20260807 06:55:29.357465 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:29.358044 11006 external_mini_cluster.cc:1428] Setting key 9d984feb04cfdcbdadc9824f753cae04
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085729, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:29.376945 16422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:29.358935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:52713 (local address 127.10.191.190:35213)
0807 06:55:29.359650 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:29.359656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:29.360550 (+ 894us) server_negotiation.cc:407] Connection header received
0807 06:55:29.362647 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:29.362652 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:29.362753 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:29.362865 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:29.364409 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.365215 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.366868 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.367278 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.367419 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:29.370885 (+ 3466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:29.370889 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:29.370892 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:29.370926 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:29.374275 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.374969 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.374973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.374975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.375095 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.375457 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.375459 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.375461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.375720 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:29.375823 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:29.376452 (+ 629us) server_negotiation.cc:299] Negotiation successful
0807 06:55:29.376624 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":455,"threads_started":1}
I20260807 06:55:29.378034 16423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:29.359562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35213 (local address 127.10.191.131:52713)
0807 06:55:29.360395 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:29.360455 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:29.362389 (+ 1934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:29.363110 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:29.363118 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:29.363629 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:29.364232 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:29.364261 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.365384 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.365402 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:29.366729 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:29.366740 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.367524 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.367532 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:29.367769 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:29.368477 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:29.368505 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:29.370671 (+ 2166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:29.374413 (+ 3742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:29.374420 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:29.374435 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:29.374867 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:29.375186 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:29.375189 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:29.375191 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:29.375369 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:29.375820 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:29.375826 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:29.376143 (+ 317us) client_negotiation.cc:769] Sending connection context
0807 06:55:29.376370 (+ 227us) client_negotiation.cc:240] Negotiation successful
0807 06:55:29.376838 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":308,"threads_started":1}
I20260807 06:55:29.379361 16420 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35213
I20260807 06:55:29.379671 16420 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:29.380421 16420 heartbeater.cc:511] Master 127.10.191.190:35213 requested a full tablet report, sending...
I20260807 06:55:29.381963 15732 ts_manager.cc:194] Registered new tserver with Master: b2c0c1c98cb64234ae922e60be3838c3 (127.10.191.131:36825)
I20260807 06:55:29.382761 15732 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:52713
I20260807 06:55:29.386508 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[15653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085729, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085729, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:29.446480 16422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:29.431827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54490 (local address 127.10.191.190:35213)
0807 06:55:29.432096 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:29.432104 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:29.432469 (+ 365us) server_negotiation.cc:407] Connection header received
0807 06:55:29.432722 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:29.432726 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:29.432805 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:29.432951 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:29.434350 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.435178 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.436446 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.436859 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.437003 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:29.441012 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:29.441017 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:29.441021 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:29.441107 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:29.443972 (+ 2865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.444657 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.444661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.444663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.444800 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.445227 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.445230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.445232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.445564 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:29.445770 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:29.445982 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 06:55:29.446182 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260807 06:55:29.447101 15732 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54490
I20260807 06:55:29.448853 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 15821
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085729, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:29.464444 16433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:29.449933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34790 (local address 127.10.191.129:42499)
0807 06:55:29.450544 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:29.450551 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:29.450576 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:55:29.450631 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:29.450638 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:29.450841 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:29.451025 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:29.452171 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.453256 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.454396 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.454911 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.455003 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:29.458913 (+ 3910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:29.458925 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:29.458940 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:29.458974 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:29.462032 (+ 3058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.462665 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.462674 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.462676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.462804 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.463137 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.463140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.463142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.463488 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:29.463719 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:29.463962 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 06:55:29.464157 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":311,"threads_started":1}
W20260807 06:55:29.465930 16000 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34790
W20260807 06:55:29.467089 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 15821: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 06:55:29.467304 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 15821
I20260807 06:55:29.493813 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 16017
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085729, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:55:29.510475 16434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:29.494734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45486 (local address 127.10.191.130:46839)
0807 06:55:29.495352 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:29.495360 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:29.495388 (+ 28us) server_negotiation.cc:407] Connection header received
0807 06:55:29.495454 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:29.495461 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:29.495692 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:29.495826 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:29.497239 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.498265 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.499427 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.500045 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.500154 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:29.504479 (+ 4325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:29.504494 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:29.504510 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:29.504605 (+ 95us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:29.507606 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.508274 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.508282 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.508284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.508419 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.508736 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.508739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.508741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.509326 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:29.509590 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:29.509841 (+ 251us) server_negotiation.cc:299] Negotiation successful
0807 06:55:29.510058 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":328,"threads_started":1}
W20260807 06:55:29.511868 16193 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45486
W20260807 06:55:29.513109 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 16017: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 06:55:29.513275 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 16017
I20260807 06:55:29.542331 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 16211
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[15653](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085729, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:55:29.558848 16436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:29.543282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53154 (local address 127.10.191.131:36825)
0807 06:55:29.543914 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:29.543921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:29.543949 (+ 28us) server_negotiation.cc:407] Connection header received
0807 06:55:29.544011 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:29.544017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:29.544220 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:29.544394 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:29.545829 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.546959 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.548226 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:29.548780 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:29.548917 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:29.553245 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:29.553256 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:29.553271 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:29.553312 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:29.555790 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.556490 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.556496 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.556498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.556641 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:29.557312 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:29.557315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:29.557317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:29.557690 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:29.557935 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:29.558252 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 06:55:29.558453 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":318,"threads_started":1}
W20260807 06:55:29.560213 16414 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53154
W20260807 06:55:29.561383 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 16211: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 06:55:29.561561 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 16211
I20260807 06:55:29.584408 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 15686
I20260807 06:55:29.585670 15770 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:29.689589 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 15686
2026-08-07T06:55:29Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4080 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[16443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[16443](info): set up 2 sockets
Aug 07 06:55:29 dist-test-slave-tfpf krb5kdc[16443](info): commencing operation
krb5kdc: starting...
W20260807 06:55:30.919895 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.008s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:31 dist-test-slave-tfpf krb5kdc[16443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:55:31.178222 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42599
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:32849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:42599
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:31.520047 16463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:31.520426 16463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:31.520588 16463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:31.527817 16463 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:31.527969 16463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:31.528074 16463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:31.528168 16463 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:31.528236 16463 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:31.538054 16463 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:32849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:42599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:31.539520 16463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:31.540936 16463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:31.553539 16473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:31.553635 16468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:31.553694 16469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:31.554749 16463 server_base.cc:1034] running on GCE node
I20260807 06:55:31.555586 16463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:31.557219 16463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:31.558452 16463 hybrid_clock.cc:648] HybridClock initialized: now 1786085731558401 us; error 60 us; skew 500 ppm
I20260807 06:55:31.558794 16463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:31 dist-test-slave-tfpf krb5kdc[16443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085731, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:31.564909 16463 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:55:31.566629 16463 webserver.cc:460] Webserver started at http://127.10.191.190:44225/ using document root <none> and password file <none>
I20260807 06:55:31.567375 16463 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:31.567521 16463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:31.567875 16463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:31.570931 16463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "cb521cff06074366806579e80168e1d3"
format_stamp: "Formatted at 2026-08-07 06:55:31 on dist-test-slave-tfpf"
server_key: "3e006422ea02cf4d43816ca12946d088"
server_key_iv: "76c96d16ea6e1edaf804599c39394c18"
server_key_version: "encryptionkey@0"
I20260807 06:55:31.571777 16463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "cb521cff06074366806579e80168e1d3"
format_stamp: "Formatted at 2026-08-07 06:55:31 on dist-test-slave-tfpf"
server_key: "3e006422ea02cf4d43816ca12946d088"
server_key_iv: "76c96d16ea6e1edaf804599c39394c18"
server_key_version: "encryptionkey@0"
I20260807 06:55:31.577435 16463 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 06:55:31.581007 16482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:31.582481 16463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:31.582700 16463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "cb521cff06074366806579e80168e1d3"
format_stamp: "Formatted at 2026-08-07 06:55:31 on dist-test-slave-tfpf"
server_key: "3e006422ea02cf4d43816ca12946d088"
server_key_iv: "76c96d16ea6e1edaf804599c39394c18"
server_key_version: "encryptionkey@0"
I20260807 06:55:31.582928 16463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:31.599900 16463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:31.604193 16463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:31.604455 16463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:31.623610 16463 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:42599
I20260807 06:55:31.623620 16557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:42599 every 8 connection(s)
I20260807 06:55:31.625159 16463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:31.629360 16558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:31.635262 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 16463
I20260807 06:55:31.635501 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:31.636116 11006 external_mini_cluster.cc:1428] Setting key 142a4e08c028e56769ab468b036cfaa2
I20260807 06:55:31.640930 16558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3: Bootstrap starting.
I20260807 06:55:31.644949 16558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:31.646219 16558 log.cc:824] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:31.649387 16558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3: No bootstrap required, opened a new log
Aug 07 06:55:31 dist-test-slave-tfpf krb5kdc[16443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:31.659083 16558 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb521cff06074366806579e80168e1d3" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42599 } }
I20260807 06:55:31.659572 16558 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:31.659686 16558 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb521cff06074366806579e80168e1d3, State: Initialized, Role: FOLLOWER
I20260807 06:55:31.660379 16558 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb521cff06074366806579e80168e1d3" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42599 } }
I20260807 06:55:31.660673 16558 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:31.660820 16558 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:31.660904 16563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:31.638342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41788 (local address 127.10.191.190:42599)
0807 06:55:31.639159 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:31.639175 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:31.639226 (+ 51us) server_negotiation.cc:407] Connection header received
0807 06:55:31.641733 (+ 2507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:31.641764 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:31.642267 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:31.642725 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:31.644046 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:31.645867 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:31.647359 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:31.648264 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:31.648428 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:31.652469 (+ 4041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:31.652481 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:31.652504 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:31.652551 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:31.656339 (+ 3788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:31.657014 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:31.657028 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:31.657037 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:31.657286 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:31.657633 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:31.657637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:31.657641 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:31.658442 (+ 801us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:31.658752 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:31.659026 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 06:55:31.659500 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":359,"threads_started":1}
I20260807 06:55:31.661031 16558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:31.664330 16558 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb521cff06074366806579e80168e1d3" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42599 } }
I20260807 06:55:31.664841 16558 leader_election.cc:302] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb521cff06074366806579e80168e1d3; no voters:
I20260807 06:55:31.665467 16558 leader_election.cc:288] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:31.665714 16565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:31.666465 16565 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [term 1 LEADER]: Becoming Leader. State: Replica: cb521cff06074366806579e80168e1d3, State: Running, Role: LEADER
I20260807 06:55:31.666996 16565 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb521cff06074366806579e80168e1d3" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42599 } }
I20260807 06:55:31.667591 16558 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:31.670559 16566 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb521cff06074366806579e80168e1d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb521cff06074366806579e80168e1d3" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42599 } } }
I20260807 06:55:31.670900 16566 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:31.671814 16575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:31.671612 16567 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb521cff06074366806579e80168e1d3. Latest consensus state: current_term: 1 leader_uuid: "cb521cff06074366806579e80168e1d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb521cff06074366806579e80168e1d3" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42599 } } }
I20260807 06:55:31.677372 16567 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:31.681788 16575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:31.691483 16575 catalog_manager.cc:1347] Generated new cluster ID: e9753b63a271453aa237460368e68352
I20260807 06:55:31.691609 16575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:31.712770 16575 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:31.714138 16575 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:31.726836 16575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb521cff06074366806579e80168e1d3: Generated new TSK 0
I20260807 06:55:31.727725 16575 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:55:31.789644 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42599
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:32849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:32.134527 16594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:32.134809 16594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:32.134972 16594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:32.141955 16594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:32.142113 16594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:32.142313 16594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:32.152207 16594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:32849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:32.153719 16594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:32.155179 16594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:32.168725 16602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:32.168762 16603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:32.168907 16605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:32.169862 16594 server_base.cc:1034] running on GCE node
I20260807 06:55:32.170584 16594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:32.171623 16594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:32.172861 16594 hybrid_clock.cc:648] HybridClock initialized: now 1786085732172779 us; error 63 us; skew 500 ppm
I20260807 06:55:32.173280 16594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:32 dist-test-slave-tfpf krb5kdc[16443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085732, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:32.176705 16594 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:55:32.178323 16594 webserver.cc:460] Webserver started at http://127.10.191.129:37189/ using document root <none> and password file <none>
I20260807 06:55:32.179059 16594 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:32.179220 16594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:32.179565 16594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:32.182710 16594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "814395ce1d8c443ea4b427af87471ade"
format_stamp: "Formatted at 2026-08-07 06:55:32 on dist-test-slave-tfpf"
server_key: "72c1380611532a0bcd79ff5798a55b02"
server_key_iv: "4c8e5ff5ef4d25bcd68d97b03d04b83c"
server_key_version: "encryptionkey@0"
I20260807 06:55:32.183563 16594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "814395ce1d8c443ea4b427af87471ade"
format_stamp: "Formatted at 2026-08-07 06:55:32 on dist-test-slave-tfpf"
server_key: "72c1380611532a0bcd79ff5798a55b02"
server_key_iv: "4c8e5ff5ef4d25bcd68d97b03d04b83c"
server_key_version: "encryptionkey@0"
I20260807 06:55:32.189234 16594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 06:55:32.192956 16615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:32.194482 16594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:55:32.194739 16594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "814395ce1d8c443ea4b427af87471ade"
format_stamp: "Formatted at 2026-08-07 06:55:32 on dist-test-slave-tfpf"
server_key: "72c1380611532a0bcd79ff5798a55b02"
server_key_iv: "4c8e5ff5ef4d25bcd68d97b03d04b83c"
server_key_version: "encryptionkey@0"
I20260807 06:55:32.195027 16594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:32.210052 16594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:32.214474 16594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:32.214845 16594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:32.215962 16594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:32.217531 16594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:32.217650 16594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:32.217818 16594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:32.217912 16594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:32.253456 16594 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:42333
I20260807 06:55:32.253492 16785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:42333 every 8 connection(s)
I20260807 06:55:32.255364 16594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:32.256459 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 16594
I20260807 06:55:32.256734 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:32.257510 11006 external_mini_cluster.cc:1428] Setting key 58eb122c3b790021e753d57db28f7128
Aug 07 06:55:32 dist-test-slave-tfpf krb5kdc[16443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085732, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:32.277269 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:32.259365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:44645 (local address 127.10.191.190:42599)
0807 06:55:32.261471 (+ 2106us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:32.261478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:32.261503 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:55:32.261962 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:32.261967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:32.262053 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:32.262195 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:32.263752 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:32.264479 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:32.266130 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:32.266549 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:32.266699 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:32.270585 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:32.270594 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:32.270600 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:32.270644 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:32.273612 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:32.274655 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:32.274660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:32.274662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:32.274793 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:32.275330 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:32.275334 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:32.275336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:32.275610 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:32.275729 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:32.276722 (+ 993us) server_negotiation.cc:299] Negotiation successful
0807 06:55:32.276914 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1978,"thread_start_us":1868,"threads_started":1}
I20260807 06:55:32.278913 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:32.258881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42599 (local address 127.10.191.129:44645)
0807 06:55:32.259757 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:32.259797 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:32.261690 (+ 1893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:32.262451 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:32.262459 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:32.263006 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:32.263571 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:32.263589 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:32.264651 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:32.264655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:32.265977 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:32.265990 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:32.266810 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:32.266820 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:32.267074 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:32.267860 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:32.267883 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:32.270330 (+ 2447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:32.273798 (+ 3468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:32.273811 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:32.273832 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:32.274526 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:32.274907 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:32.274914 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:32.274920 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:32.275192 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:32.275755 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:32.275766 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:32.276288 (+ 522us) client_negotiation.cc:769] Sending connection context
0807 06:55:32.276614 (+ 326us) client_negotiation.cc:240] Negotiation successful
0807 06:55:32.277302 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":525,"threads_started":1}
I20260807 06:55:32.280733 16786 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42599
I20260807 06:55:32.281129 16786 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:32.281960 16786 heartbeater.cc:511] Master 127.10.191.190:42599 requested a full tablet report, sending...
I20260807 06:55:32.284648 16514 ts_manager.cc:194] Registered new tserver with Master: 814395ce1d8c443ea4b427af87471ade (127.10.191.129:42333)
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
I20260807 06:55:32.286983 16514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:44645
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:55:32.318550 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42599
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:32849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:32.668480 16797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:32.668817 16797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:32.668910 16797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:32.676115 16797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:32.676260 16797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:32.676436 16797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:32.686525 16797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:32849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:32.687893 16797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:32.689347 16797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:32.703787 16805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:32.703843 16802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:32.703868 16809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:32.704632 16797 server_base.cc:1034] running on GCE node
I20260807 06:55:32.705358 16797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:32.706254 16797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:32.707458 16797 hybrid_clock.cc:648] HybridClock initialized: now 1786085732707402 us; error 45 us; skew 500 ppm
I20260807 06:55:32.707787 16797 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:32 dist-test-slave-tfpf krb5kdc[16443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085732, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:32.711114 16797 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:55:32.712725 16797 webserver.cc:460] Webserver started at http://127.10.191.130:42399/ using document root <none> and password file <none>
I20260807 06:55:32.713507 16797 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:32.713644 16797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:32.713960 16797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:32.716984 16797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "3a86be9aed22498fbb0a0438dceef434"
format_stamp: "Formatted at 2026-08-07 06:55:32 on dist-test-slave-tfpf"
server_key: "59280d4729b09bc7e62da8d5b57d2379"
server_key_iv: "5b0eadff63de9f660c3508c65ab85bf7"
server_key_version: "encryptionkey@0"
I20260807 06:55:32.717885 16797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "3a86be9aed22498fbb0a0438dceef434"
format_stamp: "Formatted at 2026-08-07 06:55:32 on dist-test-slave-tfpf"
server_key: "59280d4729b09bc7e62da8d5b57d2379"
server_key_iv: "5b0eadff63de9f660c3508c65ab85bf7"
server_key_version: "encryptionkey@0"
I20260807 06:55:32.723255 16797 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:55:32.726972 16818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:32.728519 16797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:55:32.728713 16797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "3a86be9aed22498fbb0a0438dceef434"
format_stamp: "Formatted at 2026-08-07 06:55:32 on dist-test-slave-tfpf"
server_key: "59280d4729b09bc7e62da8d5b57d2379"
server_key_iv: "5b0eadff63de9f660c3508c65ab85bf7"
server_key_version: "encryptionkey@0"
I20260807 06:55:32.728940 16797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:32.749715 16797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:32.753957 16797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:32.754261 16797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:32.755220 16797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:32.756626 16797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:32.756762 16797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:32.756914 16797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:32.756990 16797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:32.789824 16797 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:33715
I20260807 06:55:32.789882 16981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:33715 every 8 connection(s)
I20260807 06:55:32.791157 16797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:32.796868 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 16797
I20260807 06:55:32.797128 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:32.797678 11006 external_mini_cluster.cc:1428] Setting key 7302276d039ab1edcc0782ff9f570953
Aug 07 06:55:32 dist-test-slave-tfpf krb5kdc[16443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085732, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:32.814060 16985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:32.793739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:34505 (local address 127.10.191.190:42599)
0807 06:55:32.794185 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:32.794189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:32.795031 (+ 842us) server_negotiation.cc:407] Connection header received
0807 06:55:32.797005 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:32.797013 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:32.797125 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:32.797261 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:32.799188 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:32.800193 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:32.801911 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:32.802721 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:32.802865 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:32.806551 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:32.806567 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:32.806574 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:32.806626 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:32.810272 (+ 3646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:32.811410 (+ 1138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:32.811414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:32.811417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:32.811553 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:32.812105 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:32.812108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:32.812109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:32.812390 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:32.812515 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:32.813604 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0807 06:55:32.813785 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":244,"threads_started":1}
I20260807 06:55:32.815752 16986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:32.794168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42599 (local address 127.10.191.130:34505)
0807 06:55:32.794870 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:32.794907 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:32.796633 (+ 1726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:32.797574 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:32.797585 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:32.798341 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:32.799017 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:32.799037 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:32.800359 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:32.800366 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:32.801740 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:32.801753 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:32.802947 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:32.802951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:32.803146 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:32.803869 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:32.803892 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:32.806261 (+ 2369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:32.810466 (+ 4205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:32.810477 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:32.810499 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:32.811249 (+ 750us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:32.811690 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:32.811696 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:32.811702 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:32.811981 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:32.812538 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:32.812549 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:32.813159 (+ 610us) client_negotiation.cc:769] Sending connection context
0807 06:55:32.813522 (+ 363us) client_negotiation.cc:240] Negotiation successful
0807 06:55:32.814160 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":268,"threads_started":1}
I20260807 06:55:32.817368 16982 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42599
I20260807 06:55:32.817709 16982 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:32.818470 16982 heartbeater.cc:511] Master 127.10.191.190:42599 requested a full tablet report, sending...
I20260807 06:55:32.819998 16514 ts_manager.cc:194] Registered new tserver with Master: 3a86be9aed22498fbb0a0438dceef434 (127.10.191.130:33715)
I20260807 06:55:32.820792 16514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:34505
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:55:32.856096 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42599
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:32849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:33.213927 16991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:33.214255 16991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:33.214455 16991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:33.221976 16991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:33.222131 16991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:33.222324 16991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:33.232815 16991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:32849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:33.234329 16991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:33.235730 16991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:33.249609 16997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:33.249650 17000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:33.249693 17004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:33.250811 16991 server_base.cc:1034] running on GCE node
I20260807 06:55:33.251515 16991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:33.252615 16991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:33.253883 16991 hybrid_clock.cc:648] HybridClock initialized: now 1786085733253792 us; error 70 us; skew 500 ppm
I20260807 06:55:33.254300 16991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:33 dist-test-slave-tfpf krb5kdc[16443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085733, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:33.258329 16991 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:55:33.260342 16991 webserver.cc:460] Webserver started at http://127.10.191.131:34031/ using document root <none> and password file <none>
I20260807 06:55:33.261049 16991 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:33.261269 16991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:33.261667 16991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:33.264680 16991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "fefde49a4ff747e19edeb27cf46f8833"
format_stamp: "Formatted at 2026-08-07 06:55:33 on dist-test-slave-tfpf"
server_key: "87f253545c3f5f3c01f54129c9445d8c"
server_key_iv: "9a86ce6dcfc004bb17a223a9c22c1f48"
server_key_version: "encryptionkey@0"
I20260807 06:55:33.265573 16991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "fefde49a4ff747e19edeb27cf46f8833"
format_stamp: "Formatted at 2026-08-07 06:55:33 on dist-test-slave-tfpf"
server_key: "87f253545c3f5f3c01f54129c9445d8c"
server_key_iv: "9a86ce6dcfc004bb17a223a9c22c1f48"
server_key_version: "encryptionkey@0"
I20260807 06:55:33.271004 16991 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 06:55:33.274910 17014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:33.276248 16991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260807 06:55:33.276443 16991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "fefde49a4ff747e19edeb27cf46f8833"
format_stamp: "Formatted at 2026-08-07 06:55:33 on dist-test-slave-tfpf"
server_key: "87f253545c3f5f3c01f54129c9445d8c"
server_key_iv: "9a86ce6dcfc004bb17a223a9c22c1f48"
server_key_version: "encryptionkey@0"
I20260807 06:55:33.276671 16991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:33.290534 16786 heartbeater.cc:503] Master 127.10.191.190:42599 was elected leader, sending a full tablet report...
I20260807 06:55:33.314433 16991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:33.318704 16991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:33.319057 16991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:33.320112 16991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:33.321703 16991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:33.321820 16991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:33.321980 16991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:33.322057 16991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:33.355767 16991 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:36235
I20260807 06:55:33.355857 17182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:36235 every 8 connection(s)
I20260807 06:55:33.357283 16991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:33.363823 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 16991
I20260807 06:55:33.364069 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:33.364516 11006 external_mini_cluster.cc:1428] Setting key add8797e761575162bdf6b03e36e77a6
Aug 07 06:55:33 dist-test-slave-tfpf krb5kdc[16443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085733, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:33.379077 17186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:33.360237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:46913 (local address 127.10.191.190:42599)
0807 06:55:33.360743 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:33.360747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:33.361791 (+ 1044us) server_negotiation.cc:407] Connection header received
0807 06:55:33.363711 (+ 1920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:33.363717 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:33.363832 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:33.363958 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:33.365974 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.366891 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.368936 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.369452 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.369563 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:33.373217 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:33.373222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:33.373225 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:33.373261 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:33.375922 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.376696 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.376700 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.376702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.376826 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.377295 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.377298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.377300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.377578 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:33.377713 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:33.378468 (+ 755us) server_negotiation.cc:299] Negotiation successful
0807 06:55:33.378723 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":268,"threads_started":1}
I20260807 06:55:33.380240 17187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:33.360779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42599 (local address 127.10.191.131:46913)
0807 06:55:33.361608 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:33.361650 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:33.363412 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:33.364277 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:33.364286 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:33.364915 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:33.365744 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:33.365767 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.367071 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.367076 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:33.368775 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:33.368809 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.369675 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.369681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:33.369907 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:33.370578 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:33.370602 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:33.372949 (+ 2347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:33.376064 (+ 3115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:33.376074 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:33.376088 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:33.376536 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:33.376921 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:33.376924 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:33.376926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:33.377187 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:33.377694 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:33.377699 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:33.378046 (+ 347us) client_negotiation.cc:769] Sending connection context
0807 06:55:33.378277 (+ 231us) client_negotiation.cc:240] Negotiation successful
0807 06:55:33.378739 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":338,"threads_started":1}
I20260807 06:55:33.381809 17183 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42599
I20260807 06:55:33.382153 17183 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:33.382972 17183 heartbeater.cc:511] Master 127.10.191.190:42599 requested a full tablet report, sending...
I20260807 06:55:33.384526 16514 ts_manager.cc:194] Registered new tserver with Master: fefde49a4ff747e19edeb27cf46f8833 (127.10.191.131:36235)
I20260807 06:55:33.385471 16514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:46913
I20260807 06:55:33.393743 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:55:33 dist-test-slave-tfpf krb5kdc[16443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:55:33 dist-test-slave-tfpf krb5kdc[16443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:33.456818 17193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:33.441641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37568 (local address 127.10.191.129:42333)
0807 06:55:33.442357 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:33.442364 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:33.442395 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:55:33.442460 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:33.442481 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:33.442706 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:33.442835 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:33.444689 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.445775 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.446871 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.447377 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.447467 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:33.451396 (+ 3929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:33.451410 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:33.451427 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:33.451471 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:33.454301 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.454931 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.454937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.454939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.455059 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.455369 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.455373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.455375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.455709 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:33.455940 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:33.456174 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 06:55:33.456383 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":375,"threads_started":1}
Aug 07 06:55:33 dist-test-slave-tfpf krb5kdc[16443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:33.476505 17186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:33.461623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41796 (local address 127.10.191.190:42599)
0807 06:55:33.461904 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:33.461910 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:33.462152 (+ 242us) server_negotiation.cc:407] Connection header received
0807 06:55:33.462382 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:33.462387 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:33.462493 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:33.462615 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:33.463990 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.464722 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.466043 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.466434 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.466577 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:33.470806 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:33.470811 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:33.470814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:33.470852 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:33.473757 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.474456 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.474463 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.474466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.474608 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.474997 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.475002 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.475007 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.475354 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:33.475604 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:33.475946 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 06:55:33.476174 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
W20260807 06:55:33.477258 16514 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41796
I20260807 06:55:33.478340 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 16594
I20260807 06:55:33.491366 17193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:33.479329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37584 (local address 127.10.191.129:42333)
0807 06:55:33.479543 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:33.479549 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:33.479736 (+ 187us) server_negotiation.cc:407] Connection header received
0807 06:55:33.479941 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:33.479945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:33.480009 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:33.480117 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:33.481415 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.482114 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.483320 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.483752 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.483899 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:33.486203 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:33.486207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:33.486210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:33.486242 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:33.488708 (+ 2466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.489462 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.489467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.489469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.489593 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.489983 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.489987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.489989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.490238 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:33.490484 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:33.490795 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 06:55:33.491037 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 06:55:33.492033 16779 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:33.572589 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 16594
I20260807 06:55:33.599172 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 16797
Aug 07 06:55:33 dist-test-slave-tfpf krb5kdc[16443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:55:33.615271 17201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:33.600175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.10.191.130:33715)
0807 06:55:33.600767 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:33.600775 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:33.600806 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:55:33.600869 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:33.600876 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:33.601152 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:33.601358 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:33.602624 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.603569 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.604710 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.605326 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.605420 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:33.609548 (+ 4128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:33.609568 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:33.609584 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:33.609625 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:33.612474 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.613282 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.613289 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.613291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.613435 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.613806 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.613809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.613811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.614142 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:33.614351 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:33.614630 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 06:55:33.614836 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":306,"threads_started":1}
I20260807 06:55:33.616608 16976 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:33.702183 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 16797
I20260807 06:55:33.730283 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 16991
Aug 07 06:55:33 dist-test-slave-tfpf krb5kdc[16443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:55:33.747341 17204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:33.731424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41828 (local address 127.10.191.131:36235)
0807 06:55:33.732116 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:33.732123 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:33.732155 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:55:33.732217 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:33.732223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:33.732439 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:33.732580 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:33.733948 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.735010 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.736324 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:33.736981 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:33.737167 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:33.741647 (+ 4480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:33.741662 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:33.741680 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:33.741721 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:33.744622 (+ 2901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.745458 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.745466 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.745468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.745600 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:33.745973 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:33.745976 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:33.745978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:33.746339 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:33.746581 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:33.746816 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 06:55:33.747047 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":355,"threads_started":1}
I20260807 06:55:33.748698 17174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:33.833128 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 16991
I20260807 06:55:33.859462 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 16463
I20260807 06:55:33.860749 16552 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:33.962262 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 16463
2026-08-07T06:55:33Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4274 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:34 dist-test-slave-tfpf krb5kdc[17211](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:34 dist-test-slave-tfpf krb5kdc[17211](info): set up 2 sockets
Aug 07 06:55:34 dist-test-slave-tfpf krb5kdc[17211](info): commencing operation
krb5kdc: starting...
W20260807 06:55:35.191545 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:35 dist-test-slave-tfpf krb5kdc[17211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:55:35.456847 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35947
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:37721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:35947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:35.799317 17226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:35.799605 17226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:35.799774 17226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:35.806713 17226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:35.806834 17226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:35.806951 17226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:35.807053 17226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:35.807133 17226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:35.817472 17226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:37721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:35947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:35.819365 17226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:35.820814 17226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:35.833330 17236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:35.833392 17234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:35.833367 17233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:35.835098 17226 server_base.cc:1034] running on GCE node
I20260807 06:55:35.836051 17226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:35.837713 17226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:35.838986 17226 hybrid_clock.cc:648] HybridClock initialized: now 1786085735838927 us; error 45 us; skew 500 ppm
I20260807 06:55:35.839447 17226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:35 dist-test-slave-tfpf krb5kdc[17211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085735, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:35.842905 17226 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:55:35.844292 17226 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:35.844437 17226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:35.844812 17226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:35.848050 17226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "0c3c94568d5e4c88a5bb9d233259282a"
format_stamp: "Formatted at 2026-08-07 06:55:35 on dist-test-slave-tfpf"
server_key: "f37067176dc799b2f88a10e8c24636cd"
server_key_iv: "62b6cfffb748c24395372760c898f762"
server_key_version: "encryptionkey@0"
I20260807 06:55:35.848948 17226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "0c3c94568d5e4c88a5bb9d233259282a"
format_stamp: "Formatted at 2026-08-07 06:55:35 on dist-test-slave-tfpf"
server_key: "f37067176dc799b2f88a10e8c24636cd"
server_key_iv: "62b6cfffb748c24395372760c898f762"
server_key_version: "encryptionkey@0"
I20260807 06:55:35.854368 17226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 06:55:35.858163 17243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:35.859642 17226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:55:35.859854 17226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "0c3c94568d5e4c88a5bb9d233259282a"
format_stamp: "Formatted at 2026-08-07 06:55:35 on dist-test-slave-tfpf"
server_key: "f37067176dc799b2f88a10e8c24636cd"
server_key_iv: "62b6cfffb748c24395372760c898f762"
server_key_version: "encryptionkey@0"
I20260807 06:55:35.860158 17226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:35.894748 17226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:35.899266 17226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:35.899571 17226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:35.919837 17226 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:35947
I20260807 06:55:35.919852 17313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:35947 every 8 connection(s)
I20260807 06:55:35.920961 17226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:35.924878 17314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:35.925282 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 17226
I20260807 06:55:35.925511 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:35.926157 11006 external_mini_cluster.cc:1428] Setting key d95a4d3d47edb398d2a03ac2e86c1ce7
I20260807 06:55:35.939280 17314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a: Bootstrap starting.
Aug 07 06:55:35 dist-test-slave-tfpf krb5kdc[17211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:35.943257 17314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:35.944362 17314 log.cc:824] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:35.947283 17314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a: No bootstrap required, opened a new log
I20260807 06:55:35.949986 17319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:35.928189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56606 (local address 127.10.191.190:35947)
0807 06:55:35.929023 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:35.929035 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:35.929155 (+ 120us) server_negotiation.cc:407] Connection header received
0807 06:55:35.930882 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:35.930904 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:35.931318 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:35.931698 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:35.933660 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:35.934885 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:35.936804 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:35.937612 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:35.937749 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:35.942567 (+ 4818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:35.942576 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:35.942592 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:35.942634 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:35.945735 (+ 3101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:35.946463 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:35.946470 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:35.946476 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:35.946652 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:35.947067 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:35.947074 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:35.947076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:35.947666 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:35.947963 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:35.948437 (+ 474us) server_negotiation.cc:299] Negotiation successful
0807 06:55:35.948892 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":364,"threads_started":1}
I20260807 06:55:35.955017 17314 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c3c94568d5e4c88a5bb9d233259282a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35947 } }
I20260807 06:55:35.955400 17314 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:35.955503 17314 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c3c94568d5e4c88a5bb9d233259282a, State: Initialized, Role: FOLLOWER
I20260807 06:55:35.956038 17314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c3c94568d5e4c88a5bb9d233259282a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35947 } }
I20260807 06:55:35.956288 17314 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:35.956429 17314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:35.956600 17314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:35.959163 17314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c3c94568d5e4c88a5bb9d233259282a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35947 } }
I20260807 06:55:35.959759 17314 leader_election.cc:302] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c3c94568d5e4c88a5bb9d233259282a; no voters:
I20260807 06:55:35.960271 17314 leader_election.cc:288] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:35.960414 17321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:35.961180 17321 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [term 1 LEADER]: Becoming Leader. State: Replica: 0c3c94568d5e4c88a5bb9d233259282a, State: Running, Role: LEADER
I20260807 06:55:35.961704 17321 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c3c94568d5e4c88a5bb9d233259282a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35947 } }
I20260807 06:55:35.962845 17314 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:35.964874 17324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c3c94568d5e4c88a5bb9d233259282a. Latest consensus state: current_term: 1 leader_uuid: "0c3c94568d5e4c88a5bb9d233259282a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c3c94568d5e4c88a5bb9d233259282a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35947 } } }
I20260807 06:55:35.965353 17324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:35.964912 17323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c3c94568d5e4c88a5bb9d233259282a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c3c94568d5e4c88a5bb9d233259282a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35947 } } }
I20260807 06:55:35.965847 17323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:35.969331 17327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:35.974988 17327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:35.985466 17327 catalog_manager.cc:1347] Generated new cluster ID: c11c2d503c724f1094131fd283bfc9bf
I20260807 06:55:35.985622 17327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:35.996596 17327 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:35.998099 17327 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:36.006354 17327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a: Generated new TSK 0
I20260807 06:55:36.007481 17327 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:55:36.082203 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35947
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:37721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:36.432296 17356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:36.432610 17356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:36.432716 17356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:36.439640 17356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:36.439771 17356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:36.439891 17356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:36.449379 17356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:37721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:36.450779 17356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:36.452108 17356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:36.465837 17361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:36.465870 17364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:36.465834 17368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:36.467510 17356 server_base.cc:1034] running on GCE node
I20260807 06:55:36.468228 17356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:36.469261 17356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:36.470489 17356 hybrid_clock.cc:648] HybridClock initialized: now 1786085736470441 us; error 33 us; skew 500 ppm
I20260807 06:55:36.470826 17356 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:36 dist-test-slave-tfpf krb5kdc[17211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085736, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:36.478758 17356 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:55:36.480125 17356 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:36.480232 17356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:36.480595 17356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:36.483692 17356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "f5c3eea52140480fb2e81d62b90002fd"
format_stamp: "Formatted at 2026-08-07 06:55:36 on dist-test-slave-tfpf"
server_key: "4cb6f4a9de67de0d0067380701a318c7"
server_key_iv: "d12d7f6a8263471ba4e278b3177de9f1"
server_key_version: "encryptionkey@0"
I20260807 06:55:36.484483 17356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "f5c3eea52140480fb2e81d62b90002fd"
format_stamp: "Formatted at 2026-08-07 06:55:36 on dist-test-slave-tfpf"
server_key: "4cb6f4a9de67de0d0067380701a318c7"
server_key_iv: "d12d7f6a8263471ba4e278b3177de9f1"
server_key_version: "encryptionkey@0"
I20260807 06:55:36.489660 17356 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 06:55:36.493162 17379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:36.494477 17356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:55:36.494663 17356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "f5c3eea52140480fb2e81d62b90002fd"
format_stamp: "Formatted at 2026-08-07 06:55:36 on dist-test-slave-tfpf"
server_key: "4cb6f4a9de67de0d0067380701a318c7"
server_key_iv: "d12d7f6a8263471ba4e278b3177de9f1"
server_key_version: "encryptionkey@0"
I20260807 06:55:36.494903 17356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:36.513881 17356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:36.518018 17356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:36.518333 17356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:36.519469 17356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:36.520946 17356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:36.521116 17356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:36.521253 17356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:36.521344 17356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:36.554183 17356 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:36699
I20260807 06:55:36.554227 17555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:36699 every 8 connection(s)
I20260807 06:55:36.555127 17356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:36.559701 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 17356
I20260807 06:55:36.559954 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:36.560617 11006 external_mini_cluster.cc:1428] Setting key 669cde83f44df4272a4d122d2b8932ed
Aug 07 06:55:36 dist-test-slave-tfpf krb5kdc[17211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085736, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:36.582939 17559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:36.557808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:41369 (local address 127.10.191.190:35947)
0807 06:55:36.558311 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:36.558315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:36.559306 (+ 991us) server_negotiation.cc:407] Connection header received
0807 06:55:36.561480 (+ 2174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:36.561486 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:36.561608 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:36.561739 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:36.563548 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:36.564508 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:36.566358 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:36.566794 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:36.566931 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:36.576505 (+ 9574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:36.576512 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:36.576515 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:36.576554 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:36.579174 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:36.580232 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:36.580236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:36.580238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:36.580351 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:36.580867 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:36.580870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:36.580871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:36.581220 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:36.581334 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:36.582460 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0807 06:55:36.582651 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":237,"threads_started":1}
I20260807 06:55:36.584610 17561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:36.558427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35947 (local address 127.10.191.129:41369)
0807 06:55:36.559127 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:36.559169 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:36.561122 (+ 1953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:36.562013 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:36.562022 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:36.562693 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:36.563372 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:36.563392 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:36.564730 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:36.564735 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:36.566203 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:36.566216 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:36.567055 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:36.567062 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:36.567288 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:36.573036 (+ 5748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:36.573094 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:36.576196 (+ 3102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:36.579361 (+ 3165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:36.579374 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:36.579396 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:36.580096 (+ 700us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:36.580458 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:36.580465 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:36.580471 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:36.580749 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:36.581356 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:36.581366 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:36.581974 (+ 608us) client_negotiation.cc:769] Sending connection context
0807 06:55:36.582360 (+ 386us) client_negotiation.cc:240] Negotiation successful
0807 06:55:36.583032 (+ 672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":278,"threads_started":1}
I20260807 06:55:36.586406 17557 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35947
I20260807 06:55:36.586740 17557 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:36.587456 17557 heartbeater.cc:511] Master 127.10.191.190:35947 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
I20260807 06:55:36.589857 17267 ts_manager.cc:194] Registered new tserver with Master: f5c3eea52140480fb2e81d62b90002fd (127.10.191.129:36699)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
I20260807 06:55:36.591462 17267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:41369
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:55:36.620101 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35947
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:37721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:36.972257 17566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:36.972744 17566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:36.972987 17566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:36.981467 17566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:36.981686 17566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:36.981881 17566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:36.992084 17566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:37721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:36.993770 17566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:36.995167 17566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:37.009096 17585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:37.009034 17582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:37.009615 17581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:37.010218 17566 server_base.cc:1034] running on GCE node
I20260807 06:55:37.010836 17566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:37.011919 17566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:37.013160 17566 hybrid_clock.cc:648] HybridClock initialized: now 1786085737013095 us; error 64 us; skew 500 ppm
I20260807 06:55:37.013474 17566 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:37 dist-test-slave-tfpf krb5kdc[17211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085737, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:37.016786 17566 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:55:37.018122 17566 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:37.018255 17566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:37.018584 17566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:37.021744 17566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "dd760dfdf62c48ce984fb7051508e6df"
format_stamp: "Formatted at 2026-08-07 06:55:37 on dist-test-slave-tfpf"
server_key: "ccb7cd127f219c5b7876110fdb30f70e"
server_key_iv: "d9fbc564ed5dd29c4dec55d36953820e"
server_key_version: "encryptionkey@0"
I20260807 06:55:37.022615 17566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "dd760dfdf62c48ce984fb7051508e6df"
format_stamp: "Formatted at 2026-08-07 06:55:37 on dist-test-slave-tfpf"
server_key: "ccb7cd127f219c5b7876110fdb30f70e"
server_key_iv: "d9fbc564ed5dd29c4dec55d36953820e"
server_key_version: "encryptionkey@0"
I20260807 06:55:37.027994 17566 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:55:37.031742 17592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:37.033247 17566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:37.033432 17566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "dd760dfdf62c48ce984fb7051508e6df"
format_stamp: "Formatted at 2026-08-07 06:55:37 on dist-test-slave-tfpf"
server_key: "ccb7cd127f219c5b7876110fdb30f70e"
server_key_iv: "d9fbc564ed5dd29c4dec55d36953820e"
server_key_version: "encryptionkey@0"
I20260807 06:55:37.033686 17566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:37.059870 17566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:37.064425 17566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:37.064735 17566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:37.065865 17566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:37.067353 17566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:37.067485 17566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:37.067624 17566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:37.067710 17566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:37.101107 17566 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:39789
I20260807 06:55:37.101217 17762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:39789 every 8 connection(s)
I20260807 06:55:37.102113 17566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:37.107246 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 17566
I20260807 06:55:37.107475 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:37.108067 11006 external_mini_cluster.cc:1428] Setting key e69de738550bb671525c3b25f11add24
Aug 07 06:55:37 dist-test-slave-tfpf krb5kdc[17211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085737, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:37.126451 17771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.104732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:33497 (local address 127.10.191.190:35947)
0807 06:55:37.105233 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:37.105237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:37.106164 (+ 927us) server_negotiation.cc:407] Connection header received
0807 06:55:37.108676 (+ 2512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:37.108684 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:37.108799 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:37.108932 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:37.111088 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.111964 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.114572 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.115200 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.115321 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.119973 (+ 4652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:37.119982 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:37.119996 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:37.120043 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:37.122960 (+ 2917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:37.123955 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:37.123958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:37.123961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:37.124122 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:37.124619 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:37.124623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:37.124625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:37.124887 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:37.125020 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:37.125985 (+ 965us) server_negotiation.cc:299] Negotiation successful
0807 06:55:37.126179 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":263,"threads_started":1}
I20260807 06:55:37.127992 17774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.105273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35947 (local address 127.10.191.130:33497)
0807 06:55:37.105996 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:37.106035 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:37.108302 (+ 2267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:37.109321 (+ 1019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:37.109334 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:37.110051 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:37.110879 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.110910 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.112140 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.112148 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.114409 (+ 2261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.114428 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.115458 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.115468 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.115777 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.116585 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:37.116621 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:37.119686 (+ 3065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:37.123138 (+ 3452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:37.123150 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:37.123171 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:37.123825 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:37.124234 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:37.124240 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:37.124246 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:37.124495 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:37.125029 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:37.125040 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:37.125560 (+ 520us) client_negotiation.cc:769] Sending connection context
0807 06:55:37.125891 (+ 331us) client_negotiation.cc:240] Negotiation successful
0807 06:55:37.126489 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":294,"threads_started":1}
I20260807 06:55:37.129580 17767 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35947
I20260807 06:55:37.129907 17767 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:37.130617 17767 heartbeater.cc:511] Master 127.10.191.190:35947 requested a full tablet report, sending...
I20260807 06:55:37.132344 17267 ts_manager.cc:194] Registered new tserver with Master: dd760dfdf62c48ce984fb7051508e6df (127.10.191.130:39789)
I20260807 06:55:37.133287 17267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:33497
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:55:37.168763 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35947
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:37721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:37.515139 17778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:37.515483 17778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:37.515650 17778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:37.523047 17778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:37.523223 17778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:37.523406 17778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:37.533067 17778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:37721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:37.534678 17778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:37.536051 17778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:37.549544 17789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:37.549512 17793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:37.549590 17786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:37.554699 17778 server_base.cc:1034] running on GCE node
I20260807 06:55:37.555459 17778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:37.556519 17778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:37.557900 17778 hybrid_clock.cc:648] HybridClock initialized: now 1786085737557805 us; error 94 us; skew 500 ppm
I20260807 06:55:37.558255 17778 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:37 dist-test-slave-tfpf krb5kdc[17211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085737, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:37.561481 17778 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:55:37.562880 17778 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:37.563038 17778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:37.563364 17778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:37.566692 17778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "94de3a0f9b4b4cd7b52ee114885501e1"
format_stamp: "Formatted at 2026-08-07 06:55:37 on dist-test-slave-tfpf"
server_key: "548952fced944f3f6ef05d1d43b18c40"
server_key_iv: "a0a7adce1e12e4e3d4dd97169f158b34"
server_key_version: "encryptionkey@0"
I20260807 06:55:37.567520 17778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "94de3a0f9b4b4cd7b52ee114885501e1"
format_stamp: "Formatted at 2026-08-07 06:55:37 on dist-test-slave-tfpf"
server_key: "548952fced944f3f6ef05d1d43b18c40"
server_key_iv: "a0a7adce1e12e4e3d4dd97169f158b34"
server_key_version: "encryptionkey@0"
I20260807 06:55:37.572896 17778 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 06:55:37.576596 17800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:37.578145 17778 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:37.578351 17778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "94de3a0f9b4b4cd7b52ee114885501e1"
format_stamp: "Formatted at 2026-08-07 06:55:37 on dist-test-slave-tfpf"
server_key: "548952fced944f3f6ef05d1d43b18c40"
server_key_iv: "a0a7adce1e12e4e3d4dd97169f158b34"
server_key_version: "encryptionkey@0"
I20260807 06:55:37.578604 17778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:37.593827 17778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:37.594605 17557 heartbeater.cc:503] Master 127.10.191.190:35947 was elected leader, sending a full tablet report...
I20260807 06:55:37.598901 17778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:37.599144 17778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:37.600149 17778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:37.601579 17778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:37.601670 17778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:37.601771 17778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:37.601826 17778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:37.636272 17778 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:39833
I20260807 06:55:37.636322 17965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:39833 every 8 connection(s)
I20260807 06:55:37.637269 17778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:37.646512 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 17778
I20260807 06:55:37.646715 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:37.647207 11006 external_mini_cluster.cc:1428] Setting key 7ea378d6c7be651544da7737699ba66a
Aug 07 06:55:37 dist-test-slave-tfpf krb5kdc[17211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085737, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:37.658787 17969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.640127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:55651 (local address 127.10.191.190:35947)
0807 06:55:37.640560 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:37.640564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:37.641631 (+ 1067us) server_negotiation.cc:407] Connection header received
0807 06:55:37.643547 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:37.643552 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:37.643649 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:37.643765 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:37.645421 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.646263 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.648258 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.648762 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.648895 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.652730 (+ 3835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:37.652734 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:37.652738 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:37.652773 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:37.655339 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:37.656167 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:37.656172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:37.656174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:37.656297 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:37.656794 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:37.656798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:37.656799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:37.657164 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:37.657337 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:37.658108 (+ 771us) server_negotiation.cc:299] Negotiation successful
0807 06:55:37.658376 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":193,"threads_started":1}
I20260807 06:55:37.659771 17970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.640680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35947 (local address 127.10.191.131:55651)
0807 06:55:37.641460 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:37.641512 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:37.643251 (+ 1739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:37.644051 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:37.644060 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:37.644599 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:37.645251 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.645271 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.646537 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.646541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.648085 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.648098 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.649007 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.649015 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.649361 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.650087 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:37.650126 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:37.652487 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:37.655500 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:37.655510 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:37.655530 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:37.656006 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:37.656428 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:37.656433 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:37.656437 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:37.656644 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:37.657307 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:37.657316 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:37.657702 (+ 386us) client_negotiation.cc:769] Sending connection context
0807 06:55:37.657988 (+ 286us) client_negotiation.cc:240] Negotiation successful
0807 06:55:37.658586 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":358,"threads_started":1}
I20260807 06:55:37.661332 17967 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35947
I20260807 06:55:37.661700 17967 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:37.662624 17967 heartbeater.cc:511] Master 127.10.191.190:35947 requested a full tablet report, sending...
I20260807 06:55:37.664279 17267 ts_manager.cc:194] Registered new tserver with Master: 94de3a0f9b4b4cd7b52ee114885501e1 (127.10.191.131:39833)
I20260807 06:55:37.665160 17267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:55651
I20260807 06:55:37.675665 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:55:37.692765 17969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.680268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39924 (local address 127.10.191.190:35947)
0807 06:55:37.680515 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:37.680521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:37.680765 (+ 244us) server_negotiation.cc:407] Connection header received
0807 06:55:37.680913 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:37.680917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:37.680983 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:37.681123 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:37.682639 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.683558 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.684768 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.685202 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.685302 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.687938 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:37.687943 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:37.687945 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:37.687979 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:37.690350 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:37.690952 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:37.690955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:37.690957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:37.691070 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:37.691390 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:37.691393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:37.691395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:37.691705 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:37.691916 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:37.692211 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 06:55:37.692392 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 06:55:37.697299 17267 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:37.704195 17267 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:37.741403 17989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.717232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39833 (local address 127.0.0.1:51834)
0807 06:55:37.729351 (+ 12119us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:37.729407 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:37.729641 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:37.733724 (+ 4083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:37.733729 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:37.733772 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:37.734395 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.734415 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.736335 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.736340 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.738700 (+ 2360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.738718 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.740553 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.740572 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.740752 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.740783 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:55:37.740862 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 06:55:37.740993 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11809,"mutex_wait_us":26,"spinlock_wait_cycles":1280,"thread_start_us":13359,"threads_started":1}
I20260807 06:55:37.741539 17991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.717583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51834 (local address 127.10.191.131:39833)
0807 06:55:37.731690 (+ 14107us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:37.731696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:37.731721 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:55:37.731829 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:37.731835 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:37.732097 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:37.732364 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:37.734652 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.736179 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.738890 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.740347 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.740535 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.740697 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:37.740979 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 06:55:37.741178 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13937,"thread_start_us":13799,"threads_started":1}
I20260807 06:55:37.741667 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.717710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50802 (local address 127.10.191.130:39789)
0807 06:55:37.730194 (+ 12484us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:37.730207 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:37.731160 (+ 953us) server_negotiation.cc:407] Connection header received
0807 06:55:37.732926 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:37.732934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:37.733206 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:37.733428 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:37.734641 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.735635 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.738950 (+ 3315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.739927 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.740146 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.740365 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:37.741187 (+ 822us) server_negotiation.cc:299] Negotiation successful
0807 06:55:37.741362 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12241,"thread_start_us":12517,"threads_started":1}
I20260807 06:55:37.742447 17993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.731859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36699 (local address 127.0.0.1:35760)
0807 06:55:37.732476 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:37.732497 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:37.732651 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:37.733406 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:37.733422 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:37.733457 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:37.733968 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.733984 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.735936 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.735942 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.738316 (+ 2374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.738332 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.740639 (+ 2307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.740645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.740910 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.740941 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:55:37.741850 (+ 909us) client_negotiation.cc:240] Negotiation successful
0807 06:55:37.742015 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":59,"thread_start_us":332,"threads_started":1}
I20260807 06:55:37.742868 17986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.717540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:39789 (local address 127.0.0.1:50802)
0807 06:55:37.730982 (+ 13442us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:37.731008 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:37.732688 (+ 1680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:37.733706 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:37.733714 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:37.733741 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:37.734429 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.734440 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.735775 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.735780 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.738812 (+ 3032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.738826 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.740165 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.740172 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.740390 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.740455 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 06:55:37.740606 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 06:55:37.740850 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13257,"mutex_wait_us":57,"spinlock_wait_cycles":4352,"thread_start_us":11315,"threads_started":1}
I20260807 06:55:37.743192 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.731284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35760 (local address 127.10.191.129:36699)
0807 06:55:37.731932 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:37.731941 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:37.732620 (+ 679us) server_negotiation.cc:407] Connection header received
0807 06:55:37.732842 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:37.732850 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:37.733185 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:37.733420 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:37.734177 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.735775 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.738494 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.740059 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.740281 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.740472 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:37.742662 (+ 2190us) server_negotiation.cc:299] Negotiation successful
0807 06:55:37.742863 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":308,"threads_started":1}
I20260807 06:55:37.746106 17865 tablet_service.cc:1467] Processing CreateTablet for tablet 54d2cb80dff14886a6df6c161ca7a40f (DEFAULT_TABLE table=test-table [id=cb570d2449a64d898e5dad3b747ac821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:37.746733 17448 tablet_service.cc:1467] Processing CreateTablet for tablet 54d2cb80dff14886a6df6c161ca7a40f (DEFAULT_TABLE table=test-table [id=cb570d2449a64d898e5dad3b747ac821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:37.746733 17664 tablet_service.cc:1467] Processing CreateTablet for tablet 54d2cb80dff14886a6df6c161ca7a40f (DEFAULT_TABLE table=test-table [id=cb570d2449a64d898e5dad3b747ac821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:37.748114 17865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d2cb80dff14886a6df6c161ca7a40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:37.748132 17448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d2cb80dff14886a6df6c161ca7a40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:37.748139 17664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d2cb80dff14886a6df6c161ca7a40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:37.759732 17994 tablet_bootstrap.cc:492] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: Bootstrap starting.
I20260807 06:55:37.762902 17996 tablet_bootstrap.cc:492] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: Bootstrap starting.
I20260807 06:55:37.763697 17998 tablet_bootstrap.cc:492] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: Bootstrap starting.
I20260807 06:55:37.765000 17994 tablet_bootstrap.cc:654] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:37.766312 17994 log.cc:824] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:37.767403 17998 tablet_bootstrap.cc:654] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:37.768030 17996 tablet_bootstrap.cc:654] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:37.768682 17998 log.cc:824] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:37.769207 17996 log.cc:824] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:37.770505 17994 tablet_bootstrap.cc:492] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: No bootstrap required, opened a new log
I20260807 06:55:37.770912 17994 ts_tablet_manager.cc:1397] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260807 06:55:37.775286 17998 tablet_bootstrap.cc:492] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: No bootstrap required, opened a new log
I20260807 06:55:37.775461 17996 tablet_bootstrap.cc:492] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: No bootstrap required, opened a new log
I20260807 06:55:37.775627 17998 ts_tablet_manager.cc:1397] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260807 06:55:37.775761 17996 ts_tablet_manager.cc:1397] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260807 06:55:37.781819 17994 raft_consensus.cc:348] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } }
I20260807 06:55:37.782383 17994 raft_consensus.cc:374] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:37.782569 17994 raft_consensus.cc:729] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94de3a0f9b4b4cd7b52ee114885501e1, State: Initialized, Role: FOLLOWER
I20260807 06:55:37.783278 17994 consensus_queue.cc:260] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } }
I20260807 06:55:37.784497 17967 heartbeater.cc:503] Master 127.10.191.190:35947 was elected leader, sending a full tablet report...
I20260807 06:55:37.784356 17998 raft_consensus.cc:348] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } }
I20260807 06:55:37.784798 17998 raft_consensus.cc:374] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:37.784890 17998 raft_consensus.cc:729] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c3eea52140480fb2e81d62b90002fd, State: Initialized, Role: FOLLOWER
I20260807 06:55:37.785378 17994 ts_tablet_manager.cc:1428] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260807 06:55:37.785509 17998 consensus_queue.cc:260] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } }
I20260807 06:55:37.786023 17996 raft_consensus.cc:348] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } }
I20260807 06:55:37.786506 17996 raft_consensus.cc:374] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:37.786664 17996 raft_consensus.cc:729] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd760dfdf62c48ce984fb7051508e6df, State: Initialized, Role: FOLLOWER
I20260807 06:55:37.787330 17998 ts_tablet_manager.cc:1428] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260807 06:55:37.787364 17996 consensus_queue.cc:260] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } }
I20260807 06:55:37.788512 17767 heartbeater.cc:503] Master 127.10.191.190:35947 was elected leader, sending a full tablet report...
I20260807 06:55:37.789258 17996 ts_tablet_manager.cc:1428] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: Time spent starting tablet: real 0.013s user 0.006s sys 0.009s
W20260807 06:55:37.807649 17558 tablet.cc:2369] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:55:37.854216 17768 tablet.cc:2369] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:55:37.889258 17968 tablet.cc:2369] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:55:37.963248 18007 raft_consensus.cc:482] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:37.963687 18007 raft_consensus.cc:504] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } }
I20260807 06:55:37.965881 18007 leader_election.cc:288] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94de3a0f9b4b4cd7b52ee114885501e1 (127.10.191.131:39833), f5c3eea52140480fb2e81d62b90002fd (127.10.191.129:36699)
I20260807 06:55:37.973914 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.967313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:34825 (local address 127.10.191.129:36699)
0807 06:55:37.967548 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:37.967554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:37.967637 (+ 83us) server_negotiation.cc:407] Connection header received
0807 06:55:37.967847 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:37.967855 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:37.967930 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:37.968022 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:37.968700 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.969566 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.971785 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.973011 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.973207 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.973266 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:37.973565 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 06:55:37.973679 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 06:55:37.973913 17991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.966286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:45393 (local address 127.10.191.131:39833)
0807 06:55:37.966475 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:37.966498 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:37.967069 (+ 571us) server_negotiation.cc:407] Connection header received
0807 06:55:37.967313 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:37.967318 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:37.967400 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:37.967467 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:37.968226 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.969189 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.971544 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.972869 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.973056 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.973172 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:37.973530 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 06:55:37.973672 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:55:37.974080 18012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.966286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39833 (local address 127.10.191.130:45393)
0807 06:55:37.966912 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:37.966934 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:37.967105 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:37.967700 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:37.967704 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:37.967738 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:37.968092 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.968102 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.969316 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.969320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.971388 (+ 2068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.971405 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.973141 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.973148 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.973333 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.973375 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 06:55:37.973477 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 06:55:37.973617 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":320,"threads_started":1}
I20260807 06:55:37.974102 18013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:37.966938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36699 (local address 127.10.191.130:34825)
0807 06:55:37.967522 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:37.967535 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:37.967685 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:37.968069 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:37.968079 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:37.968100 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:37.968524 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.968536 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.969687 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.969691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.971561 (+ 1870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:37.971572 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:37.973247 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:37.973251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:37.973410 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:37.973449 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 06:55:37.973524 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 06:55:37.973622 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"mutex_wait_us":1,"thread_start_us":340,"threads_started":1}
I20260807 06:55:37.975348 17897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d2cb80dff14886a6df6c161ca7a40f" candidate_uuid: "dd760dfdf62c48ce984fb7051508e6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" is_pre_election: true
I20260807 06:55:37.975350 17474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d2cb80dff14886a6df6c161ca7a40f" candidate_uuid: "dd760dfdf62c48ce984fb7051508e6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c3eea52140480fb2e81d62b90002fd" is_pre_election: true
I20260807 06:55:37.975844 17897 raft_consensus.cc:2454] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd760dfdf62c48ce984fb7051508e6df in term 0.
I20260807 06:55:37.975845 17474 raft_consensus.cc:2454] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd760dfdf62c48ce984fb7051508e6df in term 0.
I20260807 06:55:37.976507 17596 leader_election.cc:302] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94de3a0f9b4b4cd7b52ee114885501e1, dd760dfdf62c48ce984fb7051508e6df; no voters:
I20260807 06:55:37.976941 18007 raft_consensus.cc:2781] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:37.977126 18007 raft_consensus.cc:482] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:37.977267 18007 raft_consensus.cc:3037] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:37.979609 18007 raft_consensus.cc:504] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } }
I20260807 06:55:37.980257 18007 leader_election.cc:288] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [CANDIDATE]: Term 1 election: Requested vote from peers 94de3a0f9b4b4cd7b52ee114885501e1 (127.10.191.131:39833), f5c3eea52140480fb2e81d62b90002fd (127.10.191.129:36699)
I20260807 06:55:37.980733 17897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d2cb80dff14886a6df6c161ca7a40f" candidate_uuid: "dd760dfdf62c48ce984fb7051508e6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94de3a0f9b4b4cd7b52ee114885501e1"
I20260807 06:55:37.980796 17474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d2cb80dff14886a6df6c161ca7a40f" candidate_uuid: "dd760dfdf62c48ce984fb7051508e6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5c3eea52140480fb2e81d62b90002fd"
I20260807 06:55:37.980958 17897 raft_consensus.cc:3037] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:37.981096 17474 raft_consensus.cc:3037] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:37.983621 17897 raft_consensus.cc:2454] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd760dfdf62c48ce984fb7051508e6df in term 1.
I20260807 06:55:37.983644 17474 raft_consensus.cc:2454] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd760dfdf62c48ce984fb7051508e6df in term 1.
I20260807 06:55:37.984122 17596 leader_election.cc:302] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd760dfdf62c48ce984fb7051508e6df, f5c3eea52140480fb2e81d62b90002fd; no voters:
I20260807 06:55:37.984388 18007 raft_consensus.cc:2781] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:37.984856 18007 raft_consensus.cc:686] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 1 LEADER]: Becoming Leader. State: Replica: dd760dfdf62c48ce984fb7051508e6df, State: Running, Role: LEADER
I20260807 06:55:37.985435 18007 consensus_queue.cc:237] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } }
I20260807 06:55:37.990428 17266 catalog_manager.cc:5495] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df reported cstate change: term changed from 0 to 1, leader changed from <none> to dd760dfdf62c48ce984fb7051508e6df (127.10.191.130). New cstate: current_term: 1 leader_uuid: "dd760dfdf62c48ce984fb7051508e6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd760dfdf62c48ce984fb7051508e6df" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 } health_report { overall_health: UNKNOWN } } }
I20260807 06:55:38.039094 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:38.033881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50818 (local address 127.10.191.130:39789)
0807 06:55:38.034119 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:38.034123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:38.034141 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:55:38.034289 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:38.034293 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:38.034380 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:38.034507 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:38.034844 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:38.035500 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:38.036738 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:38.037250 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:38.037347 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:38.037881 (+ 534us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:38.038424 (+ 543us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:38.038539 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:38.038686 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 06:55:38.038759 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260807 06:55:38.047763 17897 raft_consensus.cc:1261] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [term 1 FOLLOWER]: Refusing update from remote peer dd760dfdf62c48ce984fb7051508e6df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:38.047847 17474 raft_consensus.cc:1261] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [term 1 FOLLOWER]: Refusing update from remote peer dd760dfdf62c48ce984fb7051508e6df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:38.048863 18014 consensus_queue.cc:1035] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "94de3a0f9b4b4cd7b52ee114885501e1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:38.049299 18007 consensus_queue.cc:1035] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c3eea52140480fb2e81d62b90002fd" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:38.077409 17267 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:38.077713 17267 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:38.081565 17267 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c3c94568d5e4c88a5bb9d233259282a: Sending DeleteTablet for 3 replicas of tablet 54d2cb80dff14886a6df6c161ca7a40f
I20260807 06:55:38.083076 17664 tablet_service.cc:1514] Processing DeleteTablet for tablet 54d2cb80dff14886a6df6c161ca7a40f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:38 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:50802
I20260807 06:55:38.083204 17865 tablet_service.cc:1514] Processing DeleteTablet for tablet 54d2cb80dff14886a6df6c161ca7a40f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:38 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:51834
I20260807 06:55:38.083236 17448 tablet_service.cc:1514] Processing DeleteTablet for tablet 54d2cb80dff14886a6df6c161ca7a40f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:38 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:35760
I20260807 06:55:38.085832 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 17356
I20260807 06:55:38.094010 18032 tablet_replica.cc:330] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: stopping tablet replica
I20260807 06:55:38.094749 18032 raft_consensus.cc:2229] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:38.095818 18032 raft_consensus.cc:2258] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:38.096722 18035 tablet_replica.cc:330] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: stopping tablet replica
I20260807 06:55:38.097199 18036 tablet_replica.cc:330] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: stopping tablet replica
I20260807 06:55:38.097261 18035 raft_consensus.cc:2229] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:38.097811 18035 raft_consensus.cc:2258] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:38.097749 18036 raft_consensus.cc:2229] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:38.098680 18036 raft_consensus.cc:2258] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:38.100411 18035 ts_tablet_manager.cc:1905] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:38.100895 18036 ts_tablet_manager.cc:1905] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:38.100898 18032 ts_tablet_manager.cc:1905] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:38.108210 18036 ts_tablet_manager.cc:1918] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:38.108304 18032 ts_tablet_manager.cc:1918] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:38.108457 18032 log.cc:1196] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/54d2cb80dff14886a6df6c161ca7a40f
I20260807 06:55:38.108736 18036 log.cc:1196] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/54d2cb80dff14886a6df6c161ca7a40f
I20260807 06:55:38.109153 18032 ts_tablet_manager.cc:1939] T 54d2cb80dff14886a6df6c161ca7a40f P dd760dfdf62c48ce984fb7051508e6df: Deleting consensus metadata
I20260807 06:55:38.109535 18036 ts_tablet_manager.cc:1939] T 54d2cb80dff14886a6df6c161ca7a40f P f5c3eea52140480fb2e81d62b90002fd: Deleting consensus metadata
I20260807 06:55:38.111107 17246 catalog_manager.cc:4841] TS dd760dfdf62c48ce984fb7051508e6df (127.10.191.130:39789): tablet 54d2cb80dff14886a6df6c161ca7a40f (table test-table [id=cb570d2449a64d898e5dad3b747ac821]) successfully deleted
I20260807 06:55:38.111346 17248 catalog_manager.cc:4841] TS f5c3eea52140480fb2e81d62b90002fd (127.10.191.129:36699): tablet 54d2cb80dff14886a6df6c161ca7a40f (table test-table [id=cb570d2449a64d898e5dad3b747ac821]) successfully deleted
I20260807 06:55:38.114490 18035 ts_tablet_manager.cc:1918] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:38.114679 18035 log.cc:1196] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/54d2cb80dff14886a6df6c161ca7a40f
I20260807 06:55:38.115168 18035 ts_tablet_manager.cc:1939] T 54d2cb80dff14886a6df6c161ca7a40f P 94de3a0f9b4b4cd7b52ee114885501e1: Deleting consensus metadata
Aug 07 06:55:38 dist-test-slave-tfpf krb5kdc[17211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:38.117018 17248 catalog_manager.cc:4841] TS 94de3a0f9b4b4cd7b52ee114885501e1 (127.10.191.131:39833): tablet 54d2cb80dff14886a6df6c161ca7a40f (table test-table [id=cb570d2449a64d898e5dad3b747ac821]) successfully deleted
I20260807 06:55:38.122772 17992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:38.087245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35774 (local address 127.10.191.129:36699)
0807 06:55:38.087472 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:38.087480 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:38.106409 (+ 18929us) server_negotiation.cc:407] Connection header received
0807 06:55:38.106875 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:38.106881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:38.106971 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:38.107076 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:38.108760 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:38.109845 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:38.111511 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:38.112072 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:38.112224 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:38.116512 (+ 4288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:38.116524 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:38.116538 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:38.116572 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:38.119659 (+ 3087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:38.120429 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:38.120438 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:38.120440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:38.120585 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:38.120991 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:38.120996 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:38.120999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:38.121455 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:38.121816 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:38.122107 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 06:55:38.122366 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 06:55:38.123508 17548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:38.211714 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 17356
I20260807 06:55:38.239733 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 17566
Aug 07 06:55:38 dist-test-slave-tfpf krb5kdc[17211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:55:38.256595 17990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:38.240529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50828 (local address 127.10.191.130:39789)
0807 06:55:38.240994 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:38.240998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:38.241012 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:55:38.241105 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:38.241112 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:38.241219 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:38.241351 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:38.242668 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:38.243598 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:38.244874 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:38.245514 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:38.245669 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:38.250050 (+ 4381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:38.250072 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:38.250090 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:38.250134 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:38.253546 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:38.254284 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:38.254292 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:38.254295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:38.254447 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:38.254871 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:38.254876 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:38.254885 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:38.255278 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:38.255638 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:38.255949 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 06:55:38.256213 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354}
I20260807 06:55:38.257504 17758 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:38.369645 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 17566
I20260807 06:55:38.400056 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 17778
Aug 07 06:55:38 dist-test-slave-tfpf krb5kdc[17211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:55:38.416158 17991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:38.400856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51846 (local address 127.10.191.131:39833)
0807 06:55:38.401035 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:38.401043 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:38.401150 (+ 107us) server_negotiation.cc:407] Connection header received
0807 06:55:38.401369 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:38.401373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:38.401437 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:38.401541 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:38.402910 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:38.403588 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:38.404780 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:38.405219 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:38.405341 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:38.409566 (+ 4225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:38.409582 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:38.409598 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:38.409640 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:38.413158 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:38.413954 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:38.413965 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:38.413969 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:38.414139 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:38.414570 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:38.414577 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:38.414580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:38.414955 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:38.415257 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:38.415580 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 06:55:38.415797 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:55:38.416880 17960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:38.502571 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 17778
I20260807 06:55:38.528749 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 17226
I20260807 06:55:38.530019 17308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:38.638310 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 17226
2026-08-07T06:55:38Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4678 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T06:55:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:38Z Disabled control of system clock
I20260807 06:55:38.733551 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36181
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:44871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:36181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:55:39.091212 18051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:39.091529 18051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:39.091692 18051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:39.098778 18051 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:39.098920 18051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:39.098958 18051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:39.099062 18051 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:39.099124 18051 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:39.108453 18051 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:36181
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:39.109861 18051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:39.111928 18051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:39.124078 18062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:39.124128 18060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:39.124154 18059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:39.125567 18051 server_base.cc:1034] running on GCE node
I20260807 06:55:39.126444 18051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:39.127943 18051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:39.129189 18051 hybrid_clock.cc:648] HybridClock initialized: now 1786085739129145 us; error 37 us; skew 500 ppm
I20260807 06:55:39.129573 18051 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:55:39.131986 18051 webserver.cc:460] Webserver started at http://127.10.191.190:38405/ using document root <none> and password file <none>
I20260807 06:55:39.132782 18051 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:39.132915 18051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:39.133370 18051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:39.136489 18051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "8a84716ad110446f8b3daf95b3f91a03"
format_stamp: "Formatted at 2026-08-07 06:55:39 on dist-test-slave-tfpf"
server_key: "adcac285e91fd4e02afacada64499ca5"
server_key_iv: "a544a80554a2cb25a100237358164249"
server_key_version: "encryptionkey@0"
I20260807 06:55:39.137476 18051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "8a84716ad110446f8b3daf95b3f91a03"
format_stamp: "Formatted at 2026-08-07 06:55:39 on dist-test-slave-tfpf"
server_key: "adcac285e91fd4e02afacada64499ca5"
server_key_iv: "a544a80554a2cb25a100237358164249"
server_key_version: "encryptionkey@0"
I20260807 06:55:39.143062 18051 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 06:55:39.147033 18071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:39.148474 18051 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:55:39.148731 18051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "8a84716ad110446f8b3daf95b3f91a03"
format_stamp: "Formatted at 2026-08-07 06:55:39 on dist-test-slave-tfpf"
server_key: "adcac285e91fd4e02afacada64499ca5"
server_key_iv: "a544a80554a2cb25a100237358164249"
server_key_version: "encryptionkey@0"
I20260807 06:55:39.148986 18051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:39.155213 18051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:39.156047 18051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:39.156388 18051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:39.175818 18051 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:36181
I20260807 06:55:39.175837 18143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:36181 every 8 connection(s)
I20260807 06:55:39.177405 18051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:39.181468 18144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:39.182305 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 18051
I20260807 06:55:39.182521 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:39.183444 11006 external_mini_cluster.cc:1428] Setting key 87e0e8afc335feca00d0e0f04e63b68f
I20260807 06:55:39.192766 18150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:39.185854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57578 (local address 127.10.191.190:36181)
0807 06:55:39.187022 (+ 1168us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:39.187034 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:39.187082 (+ 48us) server_negotiation.cc:407] Connection header received
0807 06:55:39.188733 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:39.188759 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:39.189327 (+ 568us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:39.189780 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:39.190905 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:39.190913 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:39.190925 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:39.190940 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:39.191003 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:39.191020 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:39.191288 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:39.191435 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 06:55:39.191721 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":421,"threads_started":1}
I20260807 06:55:39.195899 18144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03: Bootstrap starting.
I20260807 06:55:39.199312 18144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:39.200457 18144 log.cc:824] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:39.203675 18144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03: No bootstrap required, opened a new log
I20260807 06:55:39.211311 18144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a84716ad110446f8b3daf95b3f91a03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36181 } }
I20260807 06:55:39.211699 18144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:39.211773 18144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a84716ad110446f8b3daf95b3f91a03, State: Initialized, Role: FOLLOWER
I20260807 06:55:39.212342 18144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a84716ad110446f8b3daf95b3f91a03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36181 } }
I20260807 06:55:39.212559 18144 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:39.212666 18144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:39.212811 18144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:39.214949 18144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a84716ad110446f8b3daf95b3f91a03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36181 } }
I20260807 06:55:39.215415 18144 leader_election.cc:302] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a84716ad110446f8b3daf95b3f91a03; no voters:
I20260807 06:55:39.215981 18144 leader_election.cc:288] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:39.216166 18153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:39.216933 18153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [term 1 LEADER]: Becoming Leader. State: Replica: 8a84716ad110446f8b3daf95b3f91a03, State: Running, Role: LEADER
I20260807 06:55:39.217531 18153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a84716ad110446f8b3daf95b3f91a03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36181 } }
I20260807 06:55:39.218416 18144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:39.220662 18154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a84716ad110446f8b3daf95b3f91a03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a84716ad110446f8b3daf95b3f91a03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36181 } } }
I20260807 06:55:39.221160 18154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:39.220638 18156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a84716ad110446f8b3daf95b3f91a03. Latest consensus state: current_term: 1 leader_uuid: "8a84716ad110446f8b3daf95b3f91a03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a84716ad110446f8b3daf95b3f91a03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36181 } } }
I20260807 06:55:39.221419 18156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:39.223438 18162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:39.229526 18162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:39.239457 18162 catalog_manager.cc:1347] Generated new cluster ID: f1c446854bf14ae3b72b3c5b26b4456f
I20260807 06:55:39.239606 18162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:39.251823 18162 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:39.252336 18162 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:39.260402 18162 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03: Generated new TSK 0
I20260807 06:55:39.261437 18162 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:55:39.266551 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36181
--builtin_ntp_servers=127.10.191.148:44871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:55:39.648693 18181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:39.648986 18181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:39.649237 18181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:39.656754 18181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:39.656865 18181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:39.657055 18181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:39.666371 18181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:39.667877 18181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:39.669790 18181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:39.683502 18187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:39.683552 18189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:39.683578 18191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:39.684661 18181 server_base.cc:1034] running on GCE node
I20260807 06:55:39.685405 18181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:39.686391 18181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:39.687623 18181 hybrid_clock.cc:648] HybridClock initialized: now 1786085739687559 us; error 41 us; skew 500 ppm
I20260807 06:55:39.687947 18181 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:55:39.690448 18181 webserver.cc:460] Webserver started at http://127.10.191.129:46865/ using document root <none> and password file <none>
I20260807 06:55:39.691159 18181 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:39.691247 18181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:39.691535 18181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:39.694726 18181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "6af581a5edad46328ec51ea1682db258"
format_stamp: "Formatted at 2026-08-07 06:55:39 on dist-test-slave-tfpf"
server_key: "6a60e8d96f1d296cec1fd5a513afd012"
server_key_iv: "645ada3bc95afe51ce52013317d59b7f"
server_key_version: "encryptionkey@0"
I20260807 06:55:39.695536 18181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "6af581a5edad46328ec51ea1682db258"
format_stamp: "Formatted at 2026-08-07 06:55:39 on dist-test-slave-tfpf"
server_key: "6a60e8d96f1d296cec1fd5a513afd012"
server_key_iv: "645ada3bc95afe51ce52013317d59b7f"
server_key_version: "encryptionkey@0"
I20260807 06:55:39.700917 18181 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 06:55:39.704630 18203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:39.706131 18181 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:39.706265 18181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "6af581a5edad46328ec51ea1682db258"
format_stamp: "Formatted at 2026-08-07 06:55:39 on dist-test-slave-tfpf"
server_key: "6a60e8d96f1d296cec1fd5a513afd012"
server_key_iv: "645ada3bc95afe51ce52013317d59b7f"
server_key_version: "encryptionkey@0"
I20260807 06:55:39.706452 18181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:39.712385 18181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:39.713256 18181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:39.713488 18181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:39.714334 18181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:39.715696 18181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:39.715797 18181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:39.715878 18181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:39.715931 18181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:39.751578 18181 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:45987
I20260807 06:55:39.751626 18366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:45987 every 8 connection(s)
I20260807 06:55:39.753263 18181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:39.759287 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 18181
I20260807 06:55:39.759490 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:39.760250 11006 external_mini_cluster.cc:1428] Setting key 404ac2f345370346c635ff8f3985fa38
I20260807 06:55:39.761971 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:39.756035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:33403 (local address 127.10.191.190:36181)
0807 06:55:39.756535 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:39.756540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:39.757780 (+ 1240us) server_negotiation.cc:407] Connection header received
0807 06:55:39.759517 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:39.759524 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:39.759596 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:39.759736 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:39.761233 (+ 1497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:39.761239 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:39.761243 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:39.761269 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:39.761321 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:39.761336 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:39.761479 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:39.761684 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 06:55:39.761737 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":260,"threads_started":1}
I20260807 06:55:39.763381 18371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:39.756587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36181 (local address 127.10.191.129:33403)
0807 06:55:39.757601 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:39.757647 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:39.759178 (+ 1531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:39.759988 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:39.760002 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:39.760094 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:39.760800 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:55:39.760802 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:39.760841 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:55:39.760972 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:39.761463 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:39.761474 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:39.761481 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 06:55:39.761765 (+ 284us) client_negotiation.cc:240] Negotiation successful
0807 06:55:39.762073 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":292,"threads_started":1}
I20260807 06:55:39.763427 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36181
--builtin_ntp_servers=127.10.191.148:44871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 06:55:39.764814 18367 heartbeater.cc:347] Connected to a master server at 127.10.191.190:36181
I20260807 06:55:39.765172 18367 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:39.765764 18367 heartbeater.cc:511] Master 127.10.191.190:36181 requested a full tablet report, sending...
I20260807 06:55:39.767865 18093 ts_manager.cc:194] Registered new tserver with Master: 6af581a5edad46328ec51ea1682db258 (127.10.191.129:45987)
W20260807 06:55:40.112915 18374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:40.113340 18374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:40.113533 18374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:40.121147 18374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:40.121261 18374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:40.121456 18374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:40.131014 18374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:40.132514 18374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:40.134697 18374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:40.148669 18383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:40.148721 18387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:40.148923 18384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:40.149633 18374 server_base.cc:1034] running on GCE node
I20260807 06:55:40.150347 18374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:40.151350 18374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:40.152563 18374 hybrid_clock.cc:648] HybridClock initialized: now 1786085740152511 us; error 43 us; skew 500 ppm
I20260807 06:55:40.152936 18374 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:55:40.155500 18374 webserver.cc:460] Webserver started at http://127.10.191.130:34309/ using document root <none> and password file <none>
I20260807 06:55:40.156276 18374 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:40.156404 18374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:40.156800 18374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:40.159974 18374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "460d510cf8d24092b5a4102337319e43"
format_stamp: "Formatted at 2026-08-07 06:55:40 on dist-test-slave-tfpf"
server_key: "d7b1e677df57bf98ce7971ac8d75f46c"
server_key_iv: "d58e7e9d5871ba0c1e0260056b69ac9e"
server_key_version: "encryptionkey@0"
I20260807 06:55:40.160982 18374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "460d510cf8d24092b5a4102337319e43"
format_stamp: "Formatted at 2026-08-07 06:55:40 on dist-test-slave-tfpf"
server_key: "d7b1e677df57bf98ce7971ac8d75f46c"
server_key_iv: "d58e7e9d5871ba0c1e0260056b69ac9e"
server_key_version: "encryptionkey@0"
I20260807 06:55:40.166990 18374 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260807 06:55:40.171113 18396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:40.173298 18374 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:55:40.173509 18374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "460d510cf8d24092b5a4102337319e43"
format_stamp: "Formatted at 2026-08-07 06:55:40 on dist-test-slave-tfpf"
server_key: "d7b1e677df57bf98ce7971ac8d75f46c"
server_key_iv: "d58e7e9d5871ba0c1e0260056b69ac9e"
server_key_version: "encryptionkey@0"
I20260807 06:55:40.173779 18374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:40.180179 18374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:40.181171 18374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:40.181459 18374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:40.182554 18374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:40.184242 18374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:40.184367 18374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:40.184509 18374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:40.184599 18374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:40.219947 18374 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:36737
I20260807 06:55:40.220016 18553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:36737 every 8 connection(s)
I20260807 06:55:40.221519 18374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:40.230288 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.224385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:57977 (local address 127.10.191.190:36181)
0807 06:55:40.224578 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:40.224583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:40.226132 (+ 1549us) server_negotiation.cc:407] Connection header received
0807 06:55:40.227848 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:40.227853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:40.227952 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:40.228073 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:40.229494 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:40.229500 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:40.229505 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:40.229525 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:40.229568 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:40.229580 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:40.229729 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:40.229927 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 06:55:40.230005 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 06:55:40.231279 18558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.224954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36181 (local address 127.10.191.130:57977)
0807 06:55:40.225952 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:40.225989 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:40.227549 (+ 1560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:40.228325 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:40.228333 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:40.228448 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:40.229179 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:55:40.229182 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:40.229222 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:55:40.229312 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:40.229690 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:40.229705 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:40.229713 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 06:55:40.230018 (+ 305us) client_negotiation.cc:240] Negotiation successful
0807 06:55:40.230292 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":274,"threads_started":1}
I20260807 06:55:40.231892 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 18374
I20260807 06:55:40.232118 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:40.232715 11006 external_mini_cluster.cc:1428] Setting key fd9bcc5df57d95b2e4535b86a75fde46
I20260807 06:55:40.232825 18554 heartbeater.cc:347] Connected to a master server at 127.10.191.190:36181
I20260807 06:55:40.233215 18554 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:40.233888 18554 heartbeater.cc:511] Master 127.10.191.190:36181 requested a full tablet report, sending...
I20260807 06:55:40.235474 18093 ts_manager.cc:194] Registered new tserver with Master: 460d510cf8d24092b5a4102337319e43 (127.10.191.130:36737)
I20260807 06:55:40.236003 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36181
--builtin_ntp_servers=127.10.191.148:44871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 06:55:40.583737 18559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:40.584143 18559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:40.584321 18559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:40.591835 18559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:40.592079 18559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:40.592298 18559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:40.601770 18559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:40.603325 18559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:40.605371 18559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:40.620191 18565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:40.620146 18569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:40.620232 18567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:40.621341 18559 server_base.cc:1034] running on GCE node
I20260807 06:55:40.622092 18559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:40.623284 18559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:40.624675 18559 hybrid_clock.cc:648] HybridClock initialized: now 1786085740624607 us; error 46 us; skew 500 ppm
I20260807 06:55:40.625113 18559 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:55:40.627596 18559 webserver.cc:460] Webserver started at http://127.10.191.131:34399/ using document root <none> and password file <none>
I20260807 06:55:40.628391 18559 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:40.628525 18559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:40.628902 18559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:40.632117 18559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad"
format_stamp: "Formatted at 2026-08-07 06:55:40 on dist-test-slave-tfpf"
server_key: "b5d59b084d4909f4328721ee0d8b1f43"
server_key_iv: "33b5377dd64388433192fa13ba494f00"
server_key_version: "encryptionkey@0"
I20260807 06:55:40.633023 18559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad"
format_stamp: "Formatted at 2026-08-07 06:55:40 on dist-test-slave-tfpf"
server_key: "b5d59b084d4909f4328721ee0d8b1f43"
server_key_iv: "33b5377dd64388433192fa13ba494f00"
server_key_version: "encryptionkey@0"
I20260807 06:55:40.638638 18559 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 06:55:40.642448 18577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:40.643946 18559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 06:55:40.644140 18559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad"
format_stamp: "Formatted at 2026-08-07 06:55:40 on dist-test-slave-tfpf"
server_key: "b5d59b084d4909f4328721ee0d8b1f43"
server_key_iv: "33b5377dd64388433192fa13ba494f00"
server_key_version: "encryptionkey@0"
I20260807 06:55:40.644375 18559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:40.650283 18559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:40.651190 18559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:40.651486 18559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:40.652515 18559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:40.654217 18559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:40.654340 18559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:40.654479 18559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:40.654565 18559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:40.689018 18559 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:33293
I20260807 06:55:40.689100 18730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:33293 every 8 connection(s)
I20260807 06:55:40.690526 18559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:40.693994 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 18559
I20260807 06:55:40.694176 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:40.694624 11006 external_mini_cluster.cc:1428] Setting key 9fffb122676323de18ad0bc427a13569
I20260807 06:55:40.700542 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.693765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:42111 (local address 127.10.191.190:36181)
0807 06:55:40.693979 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:40.693986 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:40.695811 (+ 1825us) server_negotiation.cc:407] Connection header received
0807 06:55:40.698025 (+ 2214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:40.698031 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:40.698112 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:40.698228 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:40.699708 (+ 1480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:40.699714 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:40.699718 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:40.699763 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:40.699797 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:40.699810 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:40.699955 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:40.700167 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 06:55:40.700241 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 06:55:40.701629 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.694463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36181 (local address 127.10.191.131:42111)
0807 06:55:40.695605 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:40.695663 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:40.697681 (+ 2018us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:40.698505 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:40.698513 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:40.698617 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:40.699361 (+ 744us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:55:40.699363 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:40.699404 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:55:40.699498 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:40.699927 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:40.699939 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:40.699946 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 06:55:40.700256 (+ 310us) client_negotiation.cc:240] Negotiation successful
0807 06:55:40.700539 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":335,"threads_started":1}
I20260807 06:55:40.703080 18732 heartbeater.cc:347] Connected to a master server at 127.10.191.190:36181
I20260807 06:55:40.703378 18732 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:40.703989 18732 heartbeater.cc:511] Master 127.10.191.190:36181 requested a full tablet report, sending...
I20260807 06:55:40.705571 18093 ts_manager.cc:194] Registered new tserver with Master: 3d25edd3896d481cbcf9ed6ad30ea6ad (127.10.191.131:33293)
I20260807 06:55:40.710649 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:55:40.718148 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.715544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57580 (local address 127.10.191.190:36181)
0807 06:55:40.715773 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:40.715781 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:40.716263 (+ 482us) server_negotiation.cc:407] Connection header received
0807 06:55:40.716405 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:40.716409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:40.716466 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:40.716548 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:40.717502 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:40.717506 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:40.717509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:40.717525 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:40.717562 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:40.717575 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:40.717682 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:40.717765 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 06:55:40.717817 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:55:40.722285 18093 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:40.730723 18093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:40.755052 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.743595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:33293 (local address 127.0.0.1:51930)
0807 06:55:40.748808 (+ 5213us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:40.748863 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:40.749009 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:40.750300 (+ 1291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:40.750307 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:40.750410 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:40.752371 (+ 1961us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:55:40.752376 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:40.752418 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:55:40.752508 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:40.754246 (+ 1738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:40.754263 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:40.754271 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 06:55:40.754442 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 06:55:40.754542 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4946,"thread_start_us":5718,"threads_started":1}
I20260807 06:55:40.757584 18746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.744086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51930 (local address 127.10.191.131:33293)
0807 06:55:40.749657 (+ 5571us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:40.749682 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:40.749720 (+ 38us) server_negotiation.cc:407] Connection header received
0807 06:55:40.749807 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:40.749816 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:40.750079 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:40.752727 (+ 2648us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:40.753974 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:40.753986 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:40.754002 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:40.754019 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:40.754076 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:40.754097 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:40.756956 (+ 2859us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:40.757044 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 06:55:40.757186 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5392,"thread_start_us":5207,"threads_started":1}
I20260807 06:55:40.760017 18744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.744094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.0.0.1:40058)
0807 06:55:40.749628 (+ 5534us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:40.749647 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:40.749842 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:40.758076 (+ 8234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:40.758082 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:40.758111 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:40.758837 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:55:40.758842 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:40.758864 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:55:40.758921 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:40.759364 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:40.759372 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:40.759381 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 06:55:40.759533 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 06:55:40.759595 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5389,"thread_start_us":4283,"threads_started":1}
I20260807 06:55:40.760959 18747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.744690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40058 (local address 127.10.191.129:45987)
0807 06:55:40.745444 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:40.745457 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:40.749758 (+ 4301us) server_negotiation.cc:407] Connection header received
0807 06:55:40.749984 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:40.749992 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:40.750181 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:40.750307 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:40.759083 (+ 8776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:40.759092 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:40.759106 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:40.759128 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:40.759211 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:40.759235 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:40.759418 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:40.760466 (+ 1048us) server_negotiation.cc:299] Negotiation successful
0807 06:55:40.760592 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":303,"threads_started":1}
I20260807 06:55:40.762763 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.749785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:36737 (local address 127.0.0.1:60610)
0807 06:55:40.755345 (+ 5560us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:40.755365 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:40.755449 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:40.759864 (+ 4415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:40.759870 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:40.759923 (+ 53us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:40.760489 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:55:40.760492 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:40.760510 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:55:40.760562 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:40.762312 (+ 1750us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:40.762317 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:40.762322 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:55:40.762436 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 06:55:40.762495 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5434,"thread_start_us":9240,"threads_started":1}
I20260807 06:55:40.762884 18750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.750151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60610 (local address 127.10.191.130:36737)
0807 06:55:40.759273 (+ 9122us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:40.759284 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:40.759318 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:55:40.759393 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:40.759402 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:40.759651 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:40.760224 (+ 573us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:40.762047 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:40.762056 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:40.762071 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:40.762089 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:40.762149 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:40.762171 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:40.762350 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:40.762456 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 06:55:40.762555 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8950,"thread_start_us":8423,"threads_started":1}
I20260807 06:55:40.764004 18636 tablet_service.cc:1467] Processing CreateTablet for tablet e3fec962b1d04ebeb67d8e59817b0763 (DEFAULT_TABLE table=test-table [id=efa32e99e83b401b85f982727b5cc155]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:40.764767 18280 tablet_service.cc:1467] Processing CreateTablet for tablet e3fec962b1d04ebeb67d8e59817b0763 (DEFAULT_TABLE table=test-table [id=efa32e99e83b401b85f982727b5cc155]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:40.765717 18636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fec962b1d04ebeb67d8e59817b0763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:40.766201 18280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fec962b1d04ebeb67d8e59817b0763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:40.766023 18465 tablet_service.cc:1467] Processing CreateTablet for tablet e3fec962b1d04ebeb67d8e59817b0763 (DEFAULT_TABLE table=test-table [id=efa32e99e83b401b85f982727b5cc155]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:40.767243 18465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fec962b1d04ebeb67d8e59817b0763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:40.770732 18367 heartbeater.cc:503] Master 127.10.191.190:36181 was elected leader, sending a full tablet report...
I20260807 06:55:40.779965 18753 tablet_bootstrap.cc:492] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: Bootstrap starting.
I20260807 06:55:40.782480 18755 tablet_bootstrap.cc:492] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: Bootstrap starting.
I20260807 06:55:40.784384 18754 tablet_bootstrap.cc:492] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258: Bootstrap starting.
I20260807 06:55:40.785995 18753 tablet_bootstrap.cc:654] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:40.786661 18755 tablet_bootstrap.cc:654] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:40.787529 18753 log.cc:824] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:40.787645 18754 tablet_bootstrap.cc:654] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:40.787979 18755 log.cc:824] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:40.788929 18754 log.cc:824] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:40.790694 18753 tablet_bootstrap.cc:492] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: No bootstrap required, opened a new log
I20260807 06:55:40.791049 18753 ts_tablet_manager.cc:1397] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260807 06:55:40.791785 18754 tablet_bootstrap.cc:492] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258: No bootstrap required, opened a new log
I20260807 06:55:40.792089 18754 ts_tablet_manager.cc:1397] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 06:55:40.792996 18755 tablet_bootstrap.cc:492] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: No bootstrap required, opened a new log
I20260807 06:55:40.793337 18755 ts_tablet_manager.cc:1397] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 06:55:40.799080 18753 raft_consensus.cc:348] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } }
I20260807 06:55:40.799527 18753 raft_consensus.cc:374] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:40.799674 18753 raft_consensus.cc:729] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 460d510cf8d24092b5a4102337319e43, State: Initialized, Role: FOLLOWER
I20260807 06:55:40.800357 18753 consensus_queue.cc:260] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } }
I20260807 06:55:40.801563 18554 heartbeater.cc:503] Master 127.10.191.190:36181 was elected leader, sending a full tablet report...
I20260807 06:55:40.802346 18753 ts_tablet_manager.cc:1428] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260807 06:55:40.802826 18754 raft_consensus.cc:348] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } }
I20260807 06:55:40.803316 18754 raft_consensus.cc:374] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:40.803484 18754 raft_consensus.cc:729] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6af581a5edad46328ec51ea1682db258, State: Initialized, Role: FOLLOWER
I20260807 06:55:40.803680 18755 raft_consensus.cc:348] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } }
I20260807 06:55:40.804124 18755 raft_consensus.cc:374] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:40.804236 18755 raft_consensus.cc:729] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d25edd3896d481cbcf9ed6ad30ea6ad, State: Initialized, Role: FOLLOWER
I20260807 06:55:40.804160 18754 consensus_queue.cc:260] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } }
I20260807 06:55:40.804795 18755 consensus_queue.cc:260] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } }
I20260807 06:55:40.806391 18754 ts_tablet_manager.cc:1428] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260807 06:55:40.807402 18732 heartbeater.cc:503] Master 127.10.191.190:36181 was elected leader, sending a full tablet report...
I20260807 06:55:40.807991 18755 ts_tablet_manager.cc:1428] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260807 06:55:40.891466 18762 raft_consensus.cc:482] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:40.891822 18762 raft_consensus.cc:504] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } }
I20260807 06:55:40.893719 18762 leader_election.cc:288] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 460d510cf8d24092b5a4102337319e43 (127.10.191.130:36737), 6af581a5edad46328ec51ea1682db258 (127.10.191.129:45987)
I20260807 06:55:40.896732 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.894207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:36737 (local address 127.10.191.131:39307)
0807 06:55:40.894374 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:40.894390 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:40.894530 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:40.894975 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:40.894984 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:40.895020 (+ 36us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:40.895809 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:55:40.895812 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:40.895831 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:55:40.895884 (+ 53us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:40.896260 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:40.896263 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:40.896270 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 06:55:40.896372 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 06:55:40.896430 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 06:55:40.896729 18750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.894089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:39307 (local address 127.10.191.130:36737)
0807 06:55:40.894287 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:40.894294 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:40.894479 (+ 185us) server_negotiation.cc:407] Connection header received
0807 06:55:40.894687 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:40.894708 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:40.894788 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:40.894886 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:40.896048 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:40.896054 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:40.896070 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:40.896092 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:40.896136 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:40.896154 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:40.896286 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:40.896365 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 06:55:40.896428 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:55:40.897729 18747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.894248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:41539 (local address 127.10.191.129:45987)
0807 06:55:40.894489 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:40.894497 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:40.895577 (+ 1080us) server_negotiation.cc:407] Connection header received
0807 06:55:40.895750 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:40.895756 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:40.895822 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:40.895949 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:40.896988 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:40.896996 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:40.897003 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:40.897022 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:40.897056 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:40.897071 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:40.897186 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:40.897405 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 06:55:40.897469 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 06:55:40.897864 18763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.894656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.10.191.131:41539)
0807 06:55:40.895466 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:40.895484 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:40.895606 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:40.896003 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:40.896008 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:40.896030 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:40.896736 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:55:40.896739 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:40.896759 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:55:40.896804 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:40.897278 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:40.897282 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:40.897284 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 06:55:40.897404 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 06:55:40.897455 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":468,"threads_started":1}
I20260807 06:55:40.897818 18491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fec962b1d04ebeb67d8e59817b0763" candidate_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "460d510cf8d24092b5a4102337319e43" is_pre_election: true
I20260807 06:55:40.898396 18491 raft_consensus.cc:2454] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d25edd3896d481cbcf9ed6ad30ea6ad in term 0.
I20260807 06:55:40.898877 18315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fec962b1d04ebeb67d8e59817b0763" candidate_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af581a5edad46328ec51ea1682db258" is_pre_election: true
I20260807 06:55:40.899147 18580 leader_election.cc:302] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d25edd3896d481cbcf9ed6ad30ea6ad, 460d510cf8d24092b5a4102337319e43; no voters:
I20260807 06:55:40.899369 18315 raft_consensus.cc:2454] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d25edd3896d481cbcf9ed6ad30ea6ad in term 0.
I20260807 06:55:40.899547 18762 raft_consensus.cc:2781] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:40.899684 18762 raft_consensus.cc:482] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:40.899820 18762 raft_consensus.cc:3037] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:40.902431 18762 raft_consensus.cc:504] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } }
I20260807 06:55:40.903162 18762 leader_election.cc:288] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [CANDIDATE]: Term 1 election: Requested vote from peers 460d510cf8d24092b5a4102337319e43 (127.10.191.130:36737), 6af581a5edad46328ec51ea1682db258 (127.10.191.129:45987)
I20260807 06:55:40.903612 18491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fec962b1d04ebeb67d8e59817b0763" candidate_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "460d510cf8d24092b5a4102337319e43"
I20260807 06:55:40.903710 18315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fec962b1d04ebeb67d8e59817b0763" candidate_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6af581a5edad46328ec51ea1682db258"
I20260807 06:55:40.903844 18491 raft_consensus.cc:3037] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:40.903911 18315 raft_consensus.cc:3037] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:40.907064 18491 raft_consensus.cc:2454] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d25edd3896d481cbcf9ed6ad30ea6ad in term 1.
I20260807 06:55:40.907064 18315 raft_consensus.cc:2454] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d25edd3896d481cbcf9ed6ad30ea6ad in term 1.
I20260807 06:55:40.907528 18580 leader_election.cc:302] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d25edd3896d481cbcf9ed6ad30ea6ad, 460d510cf8d24092b5a4102337319e43; no voters:
I20260807 06:55:40.907867 18762 raft_consensus.cc:2781] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:40.908339 18762 raft_consensus.cc:686] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 1 LEADER]: Becoming Leader. State: Replica: 3d25edd3896d481cbcf9ed6ad30ea6ad, State: Running, Role: LEADER
I20260807 06:55:40.908818 18762 consensus_queue.cc:237] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } }
I20260807 06:55:40.914271 18091 catalog_manager.cc:5495] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d25edd3896d481cbcf9ed6ad30ea6ad (127.10.191.131). New cstate: current_term: 1 leader_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d25edd3896d481cbcf9ed6ad30ea6ad" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 33293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 } health_report { overall_health: UNKNOWN } } }
W20260807 06:55:40.942380 18733 tablet.cc:2369] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:55:40.947769 18746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:40.945677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51944 (local address 127.10.191.131:33293)
0807 06:55:40.945874 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:40.945881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:40.946018 (+ 137us) server_negotiation.cc:407] Connection header received
0807 06:55:40.946195 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:40.946198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:40.946279 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:40.946365 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:40.947244 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:40.947247 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:40.947250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:40.947261 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:40.947288 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:40.947298 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:40.947387 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:40.947452 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 06:55:40.947496 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:55:40.956393 18491 raft_consensus.cc:1261] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [term 1 FOLLOWER]: Refusing update from remote peer 3d25edd3896d481cbcf9ed6ad30ea6ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:40.956393 18315 raft_consensus.cc:1261] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [term 1 FOLLOWER]: Refusing update from remote peer 3d25edd3896d481cbcf9ed6ad30ea6ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:40.957592 18764 consensus_queue.cc:1035] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "460d510cf8d24092b5a4102337319e43" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:40.957957 18762 consensus_queue.cc:1035] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6af581a5edad46328ec51ea1682db258" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 06:55:40.974285 18555 tablet.cc:2369] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:55:40.987576 18770 mvcc.cc:205] Tried to move back new op lower bound from 7315807194947166208 to 7315807194767015936. Current Snapshot: MvccSnapshot[applied={T|T < 7315807194947166208 or (T in {7315807194947166208})}]
I20260807 06:55:40.994009 18091 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:40.994341 18091 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:40.998324 18091 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a84716ad110446f8b3daf95b3f91a03: Sending DeleteTablet for 3 replicas of tablet e3fec962b1d04ebeb67d8e59817b0763
I20260807 06:55:40.999696 18636 tablet_service.cc:1514] Processing DeleteTablet for tablet e3fec962b1d04ebeb67d8e59817b0763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:40 UTC) from {username='slave'} at 127.0.0.1:51930
I20260807 06:55:40.999733 18280 tablet_service.cc:1514] Processing DeleteTablet for tablet e3fec962b1d04ebeb67d8e59817b0763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:40 UTC) from {username='slave'} at 127.0.0.1:40058
I20260807 06:55:41.001255 18465 tablet_service.cc:1514] Processing DeleteTablet for tablet e3fec962b1d04ebeb67d8e59817b0763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:40 UTC) from {username='slave'} at 127.0.0.1:60610
I20260807 06:55:41.001655 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 18181
I20260807 06:55:41.029304 18747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.002894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40066 (local address 127.10.191.129:45987)
0807 06:55:41.003146 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:41.003155 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:41.026110 (+ 22955us) server_negotiation.cc:407] Connection header received
0807 06:55:41.026709 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:41.026716 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:41.026854 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:41.026938 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:41.028316 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:41.028324 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:41.028329 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:41.028353 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:41.028395 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:41.028411 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:41.028534 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:41.028791 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 06:55:41.028871 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 06:55:41.030972 18780 tablet_replica.cc:330] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: stopping tablet replica
I20260807 06:55:41.030992 18361 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:41.031579 18780 raft_consensus.cc:2229] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:41.032552 18780 raft_consensus.cc:2258] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:41.033311 18782 tablet_replica.cc:330] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: stopping tablet replica
I20260807 06:55:41.034111 18782 raft_consensus.cc:2229] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:41.036520 18782 raft_consensus.cc:2258] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:41.037330 18780 ts_tablet_manager.cc:1905] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:41.039162 18782 ts_tablet_manager.cc:1905] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:41.046537 18780 ts_tablet_manager.cc:1918] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:41.046949 18780 log.cc:1196] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/e3fec962b1d04ebeb67d8e59817b0763
I20260807 06:55:41.047798 18780 ts_tablet_manager.cc:1939] T e3fec962b1d04ebeb67d8e59817b0763 P 3d25edd3896d481cbcf9ed6ad30ea6ad: Deleting consensus metadata
I20260807 06:55:41.050182 18073 catalog_manager.cc:4841] TS 3d25edd3896d481cbcf9ed6ad30ea6ad (127.10.191.131:33293): tablet e3fec962b1d04ebeb67d8e59817b0763 (table test-table [id=efa32e99e83b401b85f982727b5cc155]) successfully deleted
I20260807 06:55:41.051126 18782 ts_tablet_manager.cc:1918] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:41.051337 18782 log.cc:1196] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/e3fec962b1d04ebeb67d8e59817b0763
I20260807 06:55:41.051921 18782 ts_tablet_manager.cc:1939] T e3fec962b1d04ebeb67d8e59817b0763 P 460d510cf8d24092b5a4102337319e43: Deleting consensus metadata
I20260807 06:55:41.054122 18073 catalog_manager.cc:4841] TS 460d510cf8d24092b5a4102337319e43 (127.10.191.130:36737): tablet e3fec962b1d04ebeb67d8e59817b0763 (table test-table [id=efa32e99e83b401b85f982727b5cc155]) successfully deleted
I20260807 06:55:41.135715 18781 tablet_replica.cc:330] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258: stopping tablet replica
I20260807 06:55:41.136219 18781 raft_consensus.cc:2229] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:41.136750 18781 raft_consensus.cc:2258] T e3fec962b1d04ebeb67d8e59817b0763 P 6af581a5edad46328ec51ea1682db258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:41.137910 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 18181
I20260807 06:55:41.164222 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 18374
W20260807 06:55:41.164248 18074 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.191.129:45987 (error 108)
I20260807 06:55:41.166745 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.166182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.0.0.1:40070)
0807 06:55:41.166403 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:41.166541 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260807 06:55:41.167079 18074 catalog_manager.cc:4584] TS 6af581a5edad46328ec51ea1682db258 (127.10.191.129:45987): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e3fec962b1d04ebeb67d8e59817b0763: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45987: connect: Connection refused (error 111)
I20260807 06:55:41.168028 18750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.165451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60624 (local address 127.10.191.130:36737)
0807 06:55:41.165648 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:41.165654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:41.165678 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:55:41.165895 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:41.165900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:41.165993 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:41.166119 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:41.167212 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:41.167219 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:41.167224 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:41.167245 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:41.167289 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:41.167308 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:41.167437 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:41.167663 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 06:55:41.167718 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 06:55:41.168774 18544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:41.221117 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.220518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.0.0.1:40086)
0807 06:55:41.220763 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:41.220890 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 06:55:41.222378 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.221928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.0.0.1:40096)
0807 06:55:41.222118 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:41.222208 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 06:55:41.268649 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 18374
I20260807 06:55:41.283667 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.282923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.0.0.1:40102)
0807 06:55:41.283272 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:41.283425 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260807 06:55:41.285197 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.284686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.0.0.1:40112)
0807 06:55:41.284897 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:41.285000 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 06:55:41.296367 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 18559
I20260807 06:55:41.299799 18746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.297475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51950 (local address 127.10.191.131:33293)
0807 06:55:41.297662 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:41.297669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:41.297740 (+ 71us) server_negotiation.cc:407] Connection header received
0807 06:55:41.297959 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:41.297963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:41.298032 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:41.298114 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:41.299089 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:41.299093 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:41.299095 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:41.299110 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:41.299141 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:41.299152 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:41.299263 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:41.299401 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 06:55:41.299450 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:55:41.300516 18725 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:41.366303 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.365783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.0.0.1:40120)
0807 06:55:41.366002 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:41.366114 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 06:55:41.367435 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.366999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.0.0.1:40130)
0807 06:55:41.367206 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:41.367286 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260807 06:55:41.419031 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 18559
I20260807 06:55:41.442627 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 18051
I20260807 06:55:41.443970 18139 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:41.548422 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 18051
I20260807 06:55:41.548593 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:41.548145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45987 (local address 127.0.0.1:40146)
0807 06:55:41.548361 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:41.548442 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45987: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
2026-08-07T06:55:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2901 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 06:55:41.595397 11006 mini_oidc.cc:152] Starting JWKS server
I20260807 06:55:41.598318 11006 webserver.cc:460] Webserver started at https://127.0.0.1:35111/ using document root <none> and password file <none>
I20260807 06:55:41.598672 11006 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 06:55:41.599315 11006 webserver.cc:460] Webserver started at http://127.0.0.1:44905/ using document root <none> and password file <none>
2026-08-07T06:55:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:41Z Disabled control of system clock
I20260807 06:55:41.640424 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:41787
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:41787
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35111/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/testchainca.cert with env {}
W20260807 06:55:41.986717 18801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:41.987052 18801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:41.987192 18801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:41.994555 18801 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:41.994681 18801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:41.994771 18801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:41.994863 18801 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:41.994922 18801 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:55:41.995028 18801 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:55:41.995077 18801 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35111/jwks.json
I20260807 06:55:42.005327 18801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:41787
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:41787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35111/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:42.006726 18801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:42.008061 18801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:42.020514 18810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:42.020455 18815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:42.020418 18812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:42.021426 18801 server_base.cc:1034] running on GCE node
I20260807 06:55:42.022303 18801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:42.023895 18801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:42.025156 18801 hybrid_clock.cc:648] HybridClock initialized: now 1786085742025071 us; error 73 us; skew 500 ppm
I20260807 06:55:42.025627 18801 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:55:42.032876 18801 webserver.cc:460] Webserver started at http://127.10.191.190:38735/ using document root <none> and password file <none>
I20260807 06:55:42.033701 18801 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:42.033830 18801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:42.034178 18801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:42.037281 18801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "1f6e9c8861a04526b3ea5a3b049903bc"
format_stamp: "Formatted at 2026-08-07 06:55:42 on dist-test-slave-tfpf"
server_key: "b2805d0a6d5b5d3e4e5b27311bc99d90"
server_key_iv: "b2fba9f3c52b68365e6c62485874cd49"
server_key_version: "encryptionkey@0"
I20260807 06:55:42.038139 18801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "1f6e9c8861a04526b3ea5a3b049903bc"
format_stamp: "Formatted at 2026-08-07 06:55:42 on dist-test-slave-tfpf"
server_key: "b2805d0a6d5b5d3e4e5b27311bc99d90"
server_key_iv: "b2fba9f3c52b68365e6c62485874cd49"
server_key_version: "encryptionkey@0"
I20260807 06:55:42.043519 18801 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:55:42.047082 18824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:42.048580 18801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:55:42.048801 18801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "1f6e9c8861a04526b3ea5a3b049903bc"
format_stamp: "Formatted at 2026-08-07 06:55:42 on dist-test-slave-tfpf"
server_key: "b2805d0a6d5b5d3e4e5b27311bc99d90"
server_key_iv: "b2fba9f3c52b68365e6c62485874cd49"
server_key_version: "encryptionkey@0"
I20260807 06:55:42.049037 18801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:42.073133 18801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:42.074064 18801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:42.074397 18801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:42.093796 18801 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:41787
I20260807 06:55:42.093814 18897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:41787 every 8 connection(s)
I20260807 06:55:42.095268 18801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:42.097600 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 18801
I20260807 06:55:42.097846 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:42.098500 11006 external_mini_cluster.cc:1428] Setting key 98aa77204771771464710d1b31e3b7ba
I20260807 06:55:42.099996 18899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:42.115233 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:42.100676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51276 (local address 127.10.191.190:41787)
0807 06:55:42.101968 (+ 1292us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:42.101985 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:42.102042 (+ 57us) server_negotiation.cc:407] Connection header received
0807 06:55:42.104032 (+ 1990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:42.104063 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:42.104773 (+ 710us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:42.105331 (+ 558us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:42.105908 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:42.108066 (+ 2158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:42.109585 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:42.110651 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:42.110873 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:42.112081 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:42.112091 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:42.112112 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:42.112947 (+ 835us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:42.113090 (+ 143us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:42.113144 (+ 54us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:42.113269 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:42.113478 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 06:55:42.113877 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":469,"threads_started":1}
I20260807 06:55:42.116492 18899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc: Bootstrap starting.
I20260807 06:55:42.119513 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:55:42.120325 18899 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:42.121637 18899 log.cc:824] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:42.124908 18899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc: No bootstrap required, opened a new log
I20260807 06:55:42.132647 18899 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e9c8861a04526b3ea5a3b049903bc" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41787 } }
I20260807 06:55:42.133260 18899 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:42.133414 18899 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6e9c8861a04526b3ea5a3b049903bc, State: Initialized, Role: FOLLOWER
I20260807 06:55:42.134013 18899 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e9c8861a04526b3ea5a3b049903bc" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41787 } }
I20260807 06:55:42.134294 18899 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:42.134449 18899 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:42.134637 18899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:42.136889 18899 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e9c8861a04526b3ea5a3b049903bc" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41787 } }
I20260807 06:55:42.137545 18899 leader_election.cc:302] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f6e9c8861a04526b3ea5a3b049903bc; no voters:
I20260807 06:55:42.138173 18899 leader_election.cc:288] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:42.138334 18913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:42.139108 18913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [term 1 LEADER]: Becoming Leader. State: Replica: 1f6e9c8861a04526b3ea5a3b049903bc, State: Running, Role: LEADER
I20260807 06:55:42.139757 18913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e9c8861a04526b3ea5a3b049903bc" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41787 } }
I20260807 06:55:42.140396 18899 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:42.143636 18917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f6e9c8861a04526b3ea5a3b049903bc. Latest consensus state: current_term: 1 leader_uuid: "1f6e9c8861a04526b3ea5a3b049903bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e9c8861a04526b3ea5a3b049903bc" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41787 } } }
I20260807 06:55:42.143672 18914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f6e9c8861a04526b3ea5a3b049903bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e9c8861a04526b3ea5a3b049903bc" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41787 } } }
I20260807 06:55:42.144344 18917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:42.144456 18914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:42.146076 18932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:42.152137 18932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:42.162475 18932 catalog_manager.cc:1347] Generated new cluster ID: 65a90a361bbe47c3af2dfa517148c5d2
I20260807 06:55:42.162619 18932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:42.183197 18932 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:42.184875 18932 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:42.199193 18932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f6e9c8861a04526b3ea5a3b049903bc: Generated new TSK 0
I20260807 06:55:42.200177 18932 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 06:55:42.243537 18953 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 06:55:42.243777 18953 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 06:55:42.246078 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:42.222464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51290 (local address 127.10.191.190:41787)
0807 06:55:42.222698 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:42.222705 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:42.223189 (+ 484us) server_negotiation.cc:407] Connection header received
0807 06:55:42.223618 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:42.223629 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:42.223728 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:42.223918 (+ 190us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:55:42.224434 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:42.225533 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:42.226953 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:42.227668 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:42.227800 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:42.228387 (+ 587us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:55:42.245304 (+ 16917us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35111/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 06:55:42.245745 (+ 441us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51290: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35111/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":76}
W20260807 06:55:42.246220 18907 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51290: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35111/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 06:55:42.247915 18952 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:55:42.222323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:41787 (local address 127.0.0.1:51290)
0807 06:55:42.223077 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:42.223094 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:42.223276 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:42.223947 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:42.223950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:42.223960 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:55:42.224288 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:42.224296 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:42.225688 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:42.225692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:42.226805 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:42.226817 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:42.227842 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:42.227846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:42.227983 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:42.228046 (+ 63us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:55:42.245697 (+ 17651us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35111/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 06:55:42.246066 (+ 369us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.191.190:41787: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35111/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":395,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.10.191.190:41787: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35111/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 06:55:42.249666 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 18801
I20260807 06:55:42.250974 18891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:42.348897 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 18801
2026-08-07T06:55:42Z chronyd exiting
I20260807 06:55:42.409262 11006 test_util.cc:175] -----------------------------------------------
I20260807 06:55:42.409412 11006 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786085696003154-11006-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (819 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 06:55:42.413415 11006 mini_oidc.cc:152] Starting JWKS server
I20260807 06:55:42.415367 11006 webserver.cc:460] Webserver started at https://127.0.0.1:36305/ using document root <none> and password file <none>
I20260807 06:55:42.415621 11006 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 06:55:42.416290 11006 webserver.cc:460] Webserver started at http://127.0.0.1:41001/ using document root <none> and password file <none>
2026-08-07T06:55:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:42Z Disabled control of system clock
I20260807 06:55:42.458175 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:40915
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:43295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:40915
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36305/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/testchainca.cert with env {}
W20260807 06:55:42.804200 18968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:42.804549 18968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:42.804685 18968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:42.811496 18968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:42.811635 18968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:42.811714 18968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:42.811820 18968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:42.811901 18968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:55:42.812032 18968 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:55:42.812091 18968 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36305/jwks.json
I20260807 06:55:42.822306 18968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:40915
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:40915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36305/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:42.823769 18968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:42.825215 18968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:42.837565 18982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:42.837498 18986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:42.837401 18983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:42.838660 18968 server_base.cc:1034] running on GCE node
I20260807 06:55:42.839557 18968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:42.841223 18968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:42.842468 18968 hybrid_clock.cc:648] HybridClock initialized: now 1786085742842427 us; error 50 us; skew 500 ppm
I20260807 06:55:42.842870 18968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:55:42.845356 18968 webserver.cc:460] Webserver started at http://127.10.191.190:38377/ using document root <none> and password file <none>
I20260807 06:55:42.846091 18968 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:42.846228 18968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:42.846571 18968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:42.849699 18968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "7b558ceaddb941b4a06bb693bf3767e7"
format_stamp: "Formatted at 2026-08-07 06:55:42 on dist-test-slave-tfpf"
server_key: "adb2094af5d9a4b1d8e0c088d4a04aad"
server_key_iv: "6bce186425ea36c9881c52aecb46ba1a"
server_key_version: "encryptionkey@0"
I20260807 06:55:42.850538 18968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "7b558ceaddb941b4a06bb693bf3767e7"
format_stamp: "Formatted at 2026-08-07 06:55:42 on dist-test-slave-tfpf"
server_key: "adb2094af5d9a4b1d8e0c088d4a04aad"
server_key_iv: "6bce186425ea36c9881c52aecb46ba1a"
server_key_version: "encryptionkey@0"
I20260807 06:55:42.855865 18968 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:55:42.859462 18994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:42.860802 18968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 06:55:42.861178 18968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "7b558ceaddb941b4a06bb693bf3767e7"
format_stamp: "Formatted at 2026-08-07 06:55:42 on dist-test-slave-tfpf"
server_key: "adb2094af5d9a4b1d8e0c088d4a04aad"
server_key_iv: "6bce186425ea36c9881c52aecb46ba1a"
server_key_version: "encryptionkey@0"
I20260807 06:55:42.861438 18968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:42.887890 18968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:42.888865 18968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:42.889236 18968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:42.908396 18968 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:40915
I20260807 06:55:42.908403 19060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:40915 every 8 connection(s)
I20260807 06:55:42.909897 18968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:42.914105 19061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:42.914602 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 18968
I20260807 06:55:42.914809 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:42.915692 11006 external_mini_cluster.cc:1428] Setting key 87982360dff38e9bf2caeaa2fe8a6087
I20260807 06:55:42.928574 19061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7: Bootstrap starting.
I20260807 06:55:42.929843 19067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:42.917883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44258 (local address 127.10.191.190:40915)
0807 06:55:42.918983 (+ 1100us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:42.918998 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:42.919042 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:55:42.920980 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:42.921003 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:42.921558 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:42.921923 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:42.922498 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:42.923715 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:42.925437 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:42.926160 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:42.926320 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:42.927543 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:42.927549 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:42.927562 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:42.928063 (+ 501us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:42.928145 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:42.928172 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:42.928256 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:42.928487 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 06:55:42.928832 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":414,"threads_started":1}
I20260807 06:55:42.932523 19061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:42.933812 19061 log.cc:824] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:42.934214 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:55:42.937397 19061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7: No bootstrap required, opened a new log
I20260807 06:55:42.944887 19061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b558ceaddb941b4a06bb693bf3767e7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40915 } }
I20260807 06:55:42.945364 19061 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:42.945484 19061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b558ceaddb941b4a06bb693bf3767e7, State: Initialized, Role: FOLLOWER
I20260807 06:55:42.946110 19061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b558ceaddb941b4a06bb693bf3767e7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40915 } }
I20260807 06:55:42.946379 19061 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:42.946537 19061 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:42.946743 19061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:42.948905 19061 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b558ceaddb941b4a06bb693bf3767e7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40915 } }
I20260807 06:55:42.949469 19061 leader_election.cc:302] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b558ceaddb941b4a06bb693bf3767e7; no voters:
I20260807 06:55:42.950034 19061 leader_election.cc:288] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:42.950253 19070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:42.951054 19070 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [term 1 LEADER]: Becoming Leader. State: Replica: 7b558ceaddb941b4a06bb693bf3767e7, State: Running, Role: LEADER
I20260807 06:55:42.951785 19070 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b558ceaddb941b4a06bb693bf3767e7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40915 } }
I20260807 06:55:42.952708 19061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:42.954998 19072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b558ceaddb941b4a06bb693bf3767e7. Latest consensus state: current_term: 1 leader_uuid: "7b558ceaddb941b4a06bb693bf3767e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b558ceaddb941b4a06bb693bf3767e7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40915 } } }
I20260807 06:55:42.955381 19072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:42.955809 19071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b558ceaddb941b4a06bb693bf3767e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b558ceaddb941b4a06bb693bf3767e7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40915 } } }
I20260807 06:55:42.956254 19071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:42.958458 19079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:42.965700 19079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:42.980086 19079 catalog_manager.cc:1347] Generated new cluster ID: 020577a67e3740e0b85b24606e66d8b1
I20260807 06:55:42.980247 19079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:42.991448 19079 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:42.992938 19079 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:43.001641 19079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b558ceaddb941b4a06bb693bf3767e7: Generated new TSK 0
I20260807 06:55:43.002617 19079 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 06:55:43.040427 19110 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 06:55:43.040575 19110 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 06:55:43.041803 19067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:43.015090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44272 (local address 127.10.191.190:40915)
0807 06:55:43.015290 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:43.015296 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:43.015710 (+ 414us) server_negotiation.cc:407] Connection header received
0807 06:55:43.016015 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:43.016019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:43.016124 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:43.016309 (+ 185us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:55:43.016811 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.017695 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.019037 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.019487 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.019626 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:43.020160 (+ 534us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:55:43.040970 (+ 20810us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 06:55:43.041472 (+ 502us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44272: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":64}
W20260807 06:55:43.041949 19067 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44272: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 06:55:43.042044 19107 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:55:43.014956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:40915 (local address 127.0.0.1:44272)
0807 06:55:43.015600 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:43.015615 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:43.015802 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:43.016326 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:43.016332 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:43.016343 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:55:43.016616 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:43.016626 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.017849 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.017855 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:43.018889 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:43.018900 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.019684 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.019693 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:43.019834 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:43.019868 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:55:43.041300 (+ 21432us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 06:55:43.041616 (+ 316us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.191.190:40915: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36305/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":384,"threads_started":1}
I20260807 06:55:43.043727 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 18968
I20260807 06:55:43.044989 19055 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:43.134888 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 18968
2026-08-07T06:55:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (785 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 06:55:43.198729 11006 mini_oidc.cc:152] Starting JWKS server
I20260807 06:55:43.200615 11006 webserver.cc:460] Webserver started at https://127.0.0.1:40637/ using document root <none> and password file <none>
I20260807 06:55:43.200829 11006 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 06:55:43.201488 11006 webserver.cc:460] Webserver started at http://127.0.0.1:41177/ using document root <none> and password file <none>
2026-08-07T06:55:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:43Z Disabled control of system clock
I20260807 06:55:43.242844 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:43853
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:41955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:43853
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40637/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 06:55:43.593685 19123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:43.594040 19123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:43.594210 19123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:43.601871 19123 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:43.602063 19123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:43.602139 19123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:43.602285 19123 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:43.602372 19123 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:55:43.602468 19123 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:55:43.602530 19123 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40637/jwks.json
I20260807 06:55:43.611770 19123 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:41955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:43853
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:43853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40637/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:43.613313 19123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:43.615202 19123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:43.627216 19129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:43.627235 19133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:43.627202 19131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:43.628161 19123 server_base.cc:1034] running on GCE node
I20260807 06:55:43.628947 19123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:43.630499 19123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:43.631721 19123 hybrid_clock.cc:648] HybridClock initialized: now 1786085743631676 us; error 33 us; skew 500 ppm
I20260807 06:55:43.632069 19123 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:55:43.634724 19123 webserver.cc:460] Webserver started at http://127.10.191.190:44451/ using document root <none> and password file <none>
I20260807 06:55:43.635440 19123 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:43.635533 19123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:43.635824 19123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:43.639101 19123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "17eff5bec8534c58b265c04b7a3b26fe"
format_stamp: "Formatted at 2026-08-07 06:55:43 on dist-test-slave-tfpf"
server_key: "195abe4b8f735e1a832cdf9a4f9f7001"
server_key_iv: "269cc760a2134e527c3b98cbb6cce54e"
server_key_version: "encryptionkey@0"
I20260807 06:55:43.639979 19123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "17eff5bec8534c58b265c04b7a3b26fe"
format_stamp: "Formatted at 2026-08-07 06:55:43 on dist-test-slave-tfpf"
server_key: "195abe4b8f735e1a832cdf9a4f9f7001"
server_key_iv: "269cc760a2134e527c3b98cbb6cce54e"
server_key_version: "encryptionkey@0"
I20260807 06:55:43.645642 19123 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260807 06:55:43.649199 19142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:43.650708 19123 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:55:43.650931 19123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "17eff5bec8534c58b265c04b7a3b26fe"
format_stamp: "Formatted at 2026-08-07 06:55:43 on dist-test-slave-tfpf"
server_key: "195abe4b8f735e1a832cdf9a4f9f7001"
server_key_iv: "269cc760a2134e527c3b98cbb6cce54e"
server_key_version: "encryptionkey@0"
I20260807 06:55:43.651203 19123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:43.677194 19123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:43.678148 19123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:43.678478 19123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:43.697747 19123 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:43853
I20260807 06:55:43.697786 19216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:43853 every 8 connection(s)
I20260807 06:55:43.699245 19123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:43.700889 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 19123
I20260807 06:55:43.701148 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:43.701804 11006 external_mini_cluster.cc:1428] Setting key 33709461a5597430a906f5b065b55a2b
I20260807 06:55:43.703806 19218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:43.718349 19222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:43.703886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44688 (local address 127.10.191.190:43853)
0807 06:55:43.704979 (+ 1093us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:43.705001 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:43.705052 (+ 51us) server_negotiation.cc:407] Connection header received
0807 06:55:43.707051 (+ 1999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:43.707082 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:43.707731 (+ 649us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:43.708270 (+ 539us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:43.708832 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.710940 (+ 2108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.712491 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.713686 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.713889 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:43.715109 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:43.715120 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:43.715139 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:43.715947 (+ 808us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:43.716063 (+ 116us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:43.716097 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:43.716228 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:43.716452 (+ 224us) server_negotiation.cc:299] Negotiation successful
0807 06:55:43.716880 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":339,"threads_started":1}
I20260807 06:55:43.719609 19218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe: Bootstrap starting.
I20260807 06:55:43.722612 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:55:43.723419 19218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:43.724718 19218 log.cc:824] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:43.728005 19218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe: No bootstrap required, opened a new log
I20260807 06:55:43.736344 19218 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17eff5bec8534c58b265c04b7a3b26fe" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43853 } }
I20260807 06:55:43.736939 19218 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:43.737095 19218 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17eff5bec8534c58b265c04b7a3b26fe, State: Initialized, Role: FOLLOWER
I20260807 06:55:43.737870 19218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17eff5bec8534c58b265c04b7a3b26fe" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43853 } }
I20260807 06:55:43.738174 19218 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:43.738363 19218 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:43.738575 19218 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:43.741547 19218 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17eff5bec8534c58b265c04b7a3b26fe" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43853 } }
I20260807 06:55:43.742170 19218 leader_election.cc:302] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17eff5bec8534c58b265c04b7a3b26fe; no voters:
I20260807 06:55:43.743005 19218 leader_election.cc:288] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:43.743150 19224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:43.743959 19224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [term 1 LEADER]: Becoming Leader. State: Replica: 17eff5bec8534c58b265c04b7a3b26fe, State: Running, Role: LEADER
I20260807 06:55:43.744585 19224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17eff5bec8534c58b265c04b7a3b26fe" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43853 } }
I20260807 06:55:43.745572 19218 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:43.747438 19226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17eff5bec8534c58b265c04b7a3b26fe. Latest consensus state: current_term: 1 leader_uuid: "17eff5bec8534c58b265c04b7a3b26fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17eff5bec8534c58b265c04b7a3b26fe" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43853 } } }
I20260807 06:55:43.747917 19226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:43.748811 19225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17eff5bec8534c58b265c04b7a3b26fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17eff5bec8534c58b265c04b7a3b26fe" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43853 } } }
I20260807 06:55:43.749258 19225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:43.749481 19240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:43.755206 19240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:43.765336 19240 catalog_manager.cc:1347] Generated new cluster ID: 71f473b987ad417fa7baea0813a1e001
I20260807 06:55:43.765482 19240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:43.786104 19240 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:43.787513 19240 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:43.797915 19240 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17eff5bec8534c58b265c04b7a3b26fe: Generated new TSK 0
I20260807 06:55:43.798920 19240 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:55:43.826292 19222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:43.814768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44704 (local address 127.10.191.190:43853)
0807 06:55:43.815019 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:43.815024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:43.815412 (+ 388us) server_negotiation.cc:407] Connection header received
0807 06:55:43.815720 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:43.815724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:43.815812 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:43.815954 (+ 142us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:55:43.816561 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.817394 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.819419 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.820100 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.820226 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:43.822147 (+ 1921us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:55:43.825428 (+ 3281us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 06:55:43.825869 (+ 441us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44704: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":87}
W20260807 06:55:43.826468 19222 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44704: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 06:55:43.828706 19263 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:55:43.814601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43853 (local address 127.0.0.1:44704)
0807 06:55:43.815284 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:43.815305 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:43.815476 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:43.816007 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:43.816012 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:43.816027 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:55:43.816392 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:43.816405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.817548 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.817554 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:43.819242 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:43.819257 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:43.820470 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:43.820477 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:43.821699 (+ 1222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:43.821752 (+ 53us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:55:43.827927 (+ 6175us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 06:55:43.828262 (+ 335us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.191.190:43853: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40637/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":364,"threads_started":1}
I20260807 06:55:43.829530 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 19123
I20260807 06:55:43.830921 19210 generic_service.cc:196] Checking for leaks (request via RPC)
E20260807 06:55:43.841841 19265 webserver.cc:533] Webserver: sslize failed:
E20260807 06:55:43.842000 19265 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 06:55:43.924098 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 19123
2026-08-07T06:55:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (791 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T06:55:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:44Z Disabled control of system clock
I20260807 06:55:44.033620 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:43013
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:43013
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/testchainca.cert with env {}
W20260807 06:55:44.379838 19272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:44.380276 19272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:44.380381 19272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:44.387425 19272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:44.387563 19272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:44.387601 19272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:44.387647 19272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:44.387691 19272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 06:55:44.387746 19272 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 06:55:44.387784 19272 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 06:55:44.398442 19272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:43013
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:43013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:44.399852 19272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:44.401242 19272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:44.413758 19279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:44.413722 19283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:44.413700 19281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:44.414836 19272 server_base.cc:1034] running on GCE node
I20260807 06:55:44.415738 19272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:44.417485 19272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:44.418723 19272 hybrid_clock.cc:648] HybridClock initialized: now 1786085744418661 us; error 60 us; skew 500 ppm
I20260807 06:55:44.419091 19272 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:55:44.421504 19272 webserver.cc:460] Webserver started at http://127.10.191.190:34129/ using document root <none> and password file <none>
I20260807 06:55:44.422307 19272 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:44.422474 19272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:44.422838 19272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:44.425957 19272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9"
format_stamp: "Formatted at 2026-08-07 06:55:44 on dist-test-slave-tfpf"
server_key: "1a8b943c13de295d7e8061646213b8a6"
server_key_iv: "ba0c83c2fe16bb0c70185d2798ba5a59"
server_key_version: "encryptionkey@0"
I20260807 06:55:44.426826 19272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9"
format_stamp: "Formatted at 2026-08-07 06:55:44 on dist-test-slave-tfpf"
server_key: "1a8b943c13de295d7e8061646213b8a6"
server_key_iv: "ba0c83c2fe16bb0c70185d2798ba5a59"
server_key_version: "encryptionkey@0"
I20260807 06:55:44.432601 19272 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:55:44.436373 19289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:44.437865 19272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:44.438069 19272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9"
format_stamp: "Formatted at 2026-08-07 06:55:44 on dist-test-slave-tfpf"
server_key: "1a8b943c13de295d7e8061646213b8a6"
server_key_iv: "ba0c83c2fe16bb0c70185d2798ba5a59"
server_key_version: "encryptionkey@0"
I20260807 06:55:44.438309 19272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:44.467303 19272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:44.468254 19272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:44.468596 19272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:44.487429 19272 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:43013
I20260807 06:55:44.487450 19363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:43013 every 8 connection(s)
I20260807 06:55:44.488919 19272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:44.492992 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 19272
I20260807 06:55:44.493247 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:44.493301 19364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:44.494210 11006 external_mini_cluster.cc:1428] Setting key 30a1be1639f4037754aa4b4e4839928c
I20260807 06:55:44.507728 19364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9: Bootstrap starting.
I20260807 06:55:44.509348 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:44.496191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59384 (local address 127.10.191.190:43013)
0807 06:55:44.497490 (+ 1299us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:44.497501 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:44.497551 (+ 50us) server_negotiation.cc:407] Connection header received
0807 06:55:44.499686 (+ 2135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:44.499710 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:44.500202 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:44.500547 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:44.501201 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:44.502443 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:44.504432 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:44.505230 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:44.505371 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:44.506679 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:44.506687 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:44.506701 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:55:44.507245 (+ 544us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:44.507323 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:55:44.507343 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:44.507472 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:44.507726 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 06:55:44.508154 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":797,"thread_start_us":510,"threads_started":1}
I20260807 06:55:44.511619 19364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:44.512895 19364 log.cc:824] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:44.513469 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:55:44.516065 19364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9: No bootstrap required, opened a new log
I20260807 06:55:44.523967 19364 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43013 } }
I20260807 06:55:44.524441 19364 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:44.524569 19364 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cac41cea3ca4c91acfdfc7d2f823cc9, State: Initialized, Role: FOLLOWER
I20260807 06:55:44.525290 19364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43013 } }
I20260807 06:55:44.525542 19364 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:44.525698 19364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:44.525897 19364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:44.528414 19364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43013 } }
I20260807 06:55:44.529155 19364 leader_election.cc:302] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cac41cea3ca4c91acfdfc7d2f823cc9; no voters:
I20260807 06:55:44.529805 19364 leader_election.cc:288] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:44.529975 19370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:44.530759 19370 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [term 1 LEADER]: Becoming Leader. State: Replica: 9cac41cea3ca4c91acfdfc7d2f823cc9, State: Running, Role: LEADER
I20260807 06:55:44.531313 19370 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43013 } }
I20260807 06:55:44.532140 19364 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:44.534545 19373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cac41cea3ca4c91acfdfc7d2f823cc9. Latest consensus state: current_term: 1 leader_uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43013 } } }
I20260807 06:55:44.535039 19373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:44.535524 19371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cac41cea3ca4c91acfdfc7d2f823cc9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43013 } } }
I20260807 06:55:44.536001 19371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:44.537796 19377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:44.543690 19377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:44.552147 19377 catalog_manager.cc:1347] Generated new cluster ID: dfbfd63b9d004921ba961d03182bcadd
I20260807 06:55:44.552289 19377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:44.582008 19377 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:44.583379 19377 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:44.590905 19377 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9cac41cea3ca4c91acfdfc7d2f823cc9: Generated new TSK 0
I20260807 06:55:44.591796 19377 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:55:45.087132 19368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:44.619523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59398 (local address 127.10.191.190:43013)
0807 06:55:44.619807 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:44.619816 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:44.620243 (+ 427us) server_negotiation.cc:407] Connection header received
0807 06:55:44.620503 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:44.620506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:44.620587 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:44.620725 (+ 138us) server_negotiation.cc:226] Negotiated authn=JWT
0807 06:55:44.621330 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:44.622055 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:44.624131 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:44.624546 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:44.624633 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:44.625303 (+ 670us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 06:55:45.086474 (+461171us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 06:55:45.086876 (+ 402us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59398: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":97}
W20260807 06:55:45.087306 19368 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59398: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 06:55:45.087481 19403 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:55:44.619450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43013 (local address 127.0.0.1:59398)
0807 06:55:44.620113 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:44.620134 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:44.620313 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:44.620778 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:44.620784 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:44.620798 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0807 06:55:44.621129 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:44.621144 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:44.622225 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:44.622231 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:44.623981 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:44.623996 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:44.624723 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:44.624729 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:44.624912 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:44.624959 (+ 47us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 06:55:45.086816 (+461857us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 06:55:45.087098 (+ 282us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.191.190:43013: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":348,"threads_started":1}
I20260807 06:55:45.089185 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 19272
I20260807 06:55:45.090528 19356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:45.194206 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 19272
2026-08-07T06:55:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1251 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (440 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (439 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:46 dist-test-slave-tfpf krb5kdc[19422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:46 dist-test-slave-tfpf krb5kdc[19422](info): set up 2 sockets
Aug 07 06:55:46 dist-test-slave-tfpf krb5kdc[19422](info): commencing operation
krb5kdc: starting...
W20260807 06:55:47.348436 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:47 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:55:47.628798 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:40553
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:38833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:40553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:47.985327 19445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:47.985661 19445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:47.985757 19445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:47.992769 19445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:47.992904 19445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:47.992952 19445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:47.993005 19445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:47.993049 19445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:48.003332 19445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:38833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:40553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:40553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:48.004784 19445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:48.006088 19445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:48.018522 19456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:48.018606 19452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:48.018584 19453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:48.019869 19445 server_base.cc:1034] running on GCE node
I20260807 06:55:48.020695 19445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:48.022219 19445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:48.023471 19445 hybrid_clock.cc:648] HybridClock initialized: now 1786085748023427 us; error 47 us; skew 500 ppm
I20260807 06:55:48.023857 19445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:48 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085748, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:48.031435 19445 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:55:48.033174 19445 webserver.cc:460] Webserver started at http://127.10.191.190:36387/ using document root <none> and password file <none>
I20260807 06:55:48.033993 19445 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:48.034159 19445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:48.034508 19445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:48.037869 19445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "401ff6dc72764da88eab2aa3d6abee19"
format_stamp: "Formatted at 2026-08-07 06:55:48 on dist-test-slave-tfpf"
server_key: "aa90f7b70667c71c059317cf66701022"
server_key_iv: "5f707b73a8a59db3080698dcdcffdc24"
server_key_version: "encryptionkey@0"
I20260807 06:55:48.038749 19445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "401ff6dc72764da88eab2aa3d6abee19"
format_stamp: "Formatted at 2026-08-07 06:55:48 on dist-test-slave-tfpf"
server_key: "aa90f7b70667c71c059317cf66701022"
server_key_iv: "5f707b73a8a59db3080698dcdcffdc24"
server_key_version: "encryptionkey@0"
I20260807 06:55:48.044653 19445 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:55:48.048520 19466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:48.050001 19445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:55:48.050228 19445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "401ff6dc72764da88eab2aa3d6abee19"
format_stamp: "Formatted at 2026-08-07 06:55:48 on dist-test-slave-tfpf"
server_key: "aa90f7b70667c71c059317cf66701022"
server_key_iv: "5f707b73a8a59db3080698dcdcffdc24"
server_key_version: "encryptionkey@0"
I20260807 06:55:48.050455 19445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:48.074249 19445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:48.078510 19445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:48.078886 19445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:48.098771 19445 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:40553
I20260807 06:55:48.098801 19540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:40553 every 8 connection(s)
I20260807 06:55:48.100225 19445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:48.104239 19542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:48.109017 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 19445
I20260807 06:55:48.109311 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:48.109999 11006 external_mini_cluster.cc:1428] Setting key 80badd9d2c4ded362fb93de54c5a3a08
I20260807 06:55:48.118109 19542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19: Bootstrap starting.
I20260807 06:55:48.122234 19542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:48.123729 19542 log.cc:824] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:55:48 dist-test-slave-tfpf krb5kdc[19422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:48.127319 19542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19: No bootstrap required, opened a new log
I20260807 06:55:48.137746 19545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:48.112355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51662 (local address 127.10.191.190:40553)
0807 06:55:48.113392 (+ 1037us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:48.113409 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:48.113464 (+ 55us) server_negotiation.cc:407] Connection header received
0807 06:55:48.116230 (+ 2766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:48.116263 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:48.116854 (+ 591us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:48.117362 (+ 508us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:48.118790 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:48.120815 (+ 2025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:48.122289 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:48.123418 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:48.123646 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:48.128222 (+ 4576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:48.128234 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:48.128255 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:48.128301 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:48.132502 (+ 4201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:48.133417 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:48.133429 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:48.133444 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:48.133702 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:48.134101 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:48.134106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:48.134109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:48.134924 (+ 815us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:48.135251 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:48.135557 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 06:55:48.136075 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":453,"threads_started":1}
I20260807 06:55:48.138554 19542 raft_consensus.cc:348] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401ff6dc72764da88eab2aa3d6abee19" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40553 } }
I20260807 06:55:48.139020 19542 raft_consensus.cc:374] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:48.139146 19542 raft_consensus.cc:729] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 401ff6dc72764da88eab2aa3d6abee19, State: Initialized, Role: FOLLOWER
I20260807 06:55:48.139741 19542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401ff6dc72764da88eab2aa3d6abee19" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40553 } }
I20260807 06:55:48.140017 19542 raft_consensus.cc:388] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:48.140194 19542 raft_consensus.cc:482] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:48.140383 19542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:48.143047 19542 raft_consensus.cc:504] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401ff6dc72764da88eab2aa3d6abee19" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40553 } }
I20260807 06:55:48.143674 19542 leader_election.cc:302] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 401ff6dc72764da88eab2aa3d6abee19; no voters:
I20260807 06:55:48.144402 19542 leader_election.cc:288] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:48.144537 19547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:48.145367 19547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [term 1 LEADER]: Becoming Leader. State: Replica: 401ff6dc72764da88eab2aa3d6abee19, State: Running, Role: LEADER
I20260807 06:55:48.145953 19547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401ff6dc72764da88eab2aa3d6abee19" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40553 } }
I20260807 06:55:48.146708 19542 sys_catalog.cc:564] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:48.150069 19549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "401ff6dc72764da88eab2aa3d6abee19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401ff6dc72764da88eab2aa3d6abee19" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40553 } } }
I20260807 06:55:48.150549 19549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:48.151093 19550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 401ff6dc72764da88eab2aa3d6abee19. Latest consensus state: current_term: 1 leader_uuid: "401ff6dc72764da88eab2aa3d6abee19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401ff6dc72764da88eab2aa3d6abee19" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40553 } } }
I20260807 06:55:48.151494 19550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:48.154912 19559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:48.160467 19559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:48.171216 19559 catalog_manager.cc:1347] Generated new cluster ID: 0880719badc143e6b33556b0a849edca
I20260807 06:55:48.171469 19559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:48.185552 19559 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:48.186906 19559 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:48.197645 19559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 401ff6dc72764da88eab2aa3d6abee19: Generated new TSK 0
I20260807 06:55:48.198544 19559 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:55:48.264889 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40553
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:38833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:48.620703 19574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:48.621016 19574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:48.621215 19574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:48.628630 19574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:48.628756 19574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:48.628907 19574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:48.639506 19574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:38833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40553
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:48.640937 19574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:48.642488 19574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:48.657737 19583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:48.657773 19582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:48.657699 19586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:48.658494 19574 server_base.cc:1034] running on GCE node
I20260807 06:55:48.659168 19574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:48.660169 19574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:48.661389 19574 hybrid_clock.cc:648] HybridClock initialized: now 1786085748661334 us; error 42 us; skew 500 ppm
I20260807 06:55:48.661767 19574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:48 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085748, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:48.665216 19574 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:55:48.666798 19574 webserver.cc:460] Webserver started at http://127.10.191.129:35091/ using document root <none> and password file <none>
I20260807 06:55:48.667591 19574 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:48.667737 19574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:48.668087 19574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:48.671240 19574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "e202465310604871bc14d5a74b51b675"
format_stamp: "Formatted at 2026-08-07 06:55:48 on dist-test-slave-tfpf"
server_key: "58afb91afbcda86f112c6bad046287e1"
server_key_iv: "24aad534ea11411273f4eba8ae3bb083"
server_key_version: "encryptionkey@0"
I20260807 06:55:48.672374 19574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "e202465310604871bc14d5a74b51b675"
format_stamp: "Formatted at 2026-08-07 06:55:48 on dist-test-slave-tfpf"
server_key: "58afb91afbcda86f112c6bad046287e1"
server_key_iv: "24aad534ea11411273f4eba8ae3bb083"
server_key_version: "encryptionkey@0"
I20260807 06:55:48.678144 19574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 06:55:48.682004 19597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:48.683504 19574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:55:48.683712 19574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "e202465310604871bc14d5a74b51b675"
format_stamp: "Formatted at 2026-08-07 06:55:48 on dist-test-slave-tfpf"
server_key: "58afb91afbcda86f112c6bad046287e1"
server_key_iv: "24aad534ea11411273f4eba8ae3bb083"
server_key_version: "encryptionkey@0"
I20260807 06:55:48.683987 19574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:48.711270 19574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:48.715663 19574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:48.715924 19574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:48.716928 19574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:48.718407 19574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:48.718485 19574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:48.718576 19574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:48.718619 19574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:48.753701 19574 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:36235
I20260807 06:55:48.753829 19759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:36235 every 8 connection(s)
I20260807 06:55:48.755573 19574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:48.757189 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 19574
I20260807 06:55:48.757422 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:48.758195 11006 external_mini_cluster.cc:1428] Setting key 72859330d1e782453b0641872e48adcb
Aug 07 06:55:48 dist-test-slave-tfpf krb5kdc[19422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085748, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:48.778311 19764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:48.760369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:56465 (local address 127.10.191.190:40553)
0807 06:55:48.760796 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:48.760802 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:48.760822 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:55:48.762708 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:48.762716 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:48.762828 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:48.762954 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:48.764626 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:48.765761 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:48.767494 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:48.768360 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:48.768540 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:48.772189 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:48.772195 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:48.772198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:48.772248 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:48.774951 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:48.775781 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:48.775791 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:48.775793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:48.775913 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:48.776360 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:48.776367 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:48.776370 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:48.776648 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:48.776853 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:48.777685 (+ 832us) server_negotiation.cc:299] Negotiation successful
0807 06:55:48.777936 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":733,"threads_started":1}
I20260807 06:55:48.779361 19763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:48.759760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:40553 (local address 127.10.191.129:56465)
0807 06:55:48.760650 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:48.760695 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:48.762414 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:48.763171 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:48.763179 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:48.763761 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:48.764416 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:48.764433 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:48.765941 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:48.765945 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:48.767283 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:48.767303 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:48.768634 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:48.768639 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:48.768843 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:48.769627 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:48.769653 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:48.771925 (+ 2272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:48.775131 (+ 3206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:48.775142 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:48.775161 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:48.775631 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:48.776038 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:48.776043 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:48.776046 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:48.776246 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:48.776816 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:48.776827 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:48.777266 (+ 439us) client_negotiation.cc:769] Sending connection context
0807 06:55:48.777551 (+ 285us) client_negotiation.cc:240] Negotiation successful
0807 06:55:48.778138 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":649,"threads_started":1}
I20260807 06:55:48.781144 19761 heartbeater.cc:347] Connected to a master server at 127.10.191.190:40553
I20260807 06:55:48.781527 19761 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:48.782526 19761 heartbeater.cc:511] Master 127.10.191.190:40553 requested a full tablet report, sending...
I20260807 06:55:48.785449 19490 ts_manager.cc:194] Registered new tserver with Master: e202465310604871bc14d5a74b51b675 (127.10.191.129:36235)
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
I20260807 06:55:48.787611 19490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:56465
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:55:48.821933 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40553
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:38833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:49.179659 19769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:49.179992 19769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:49.180169 19769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:49.187731 19769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:49.187870 19769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:49.188041 19769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:49.198393 19769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:38833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40553
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:49.199707 19769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:49.201036 19769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:49.214902 19784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:49.214902 19782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:49.215360 19781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:49.215898 19769 server_base.cc:1034] running on GCE node
I20260807 06:55:49.216523 19769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:49.217634 19769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:49.218874 19769 hybrid_clock.cc:648] HybridClock initialized: now 1786085749218833 us; error 30 us; skew 500 ppm
I20260807 06:55:49.219187 19769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:49.222890 19769 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:55:49.225339 19769 webserver.cc:460] Webserver started at http://127.10.191.130:33007/ using document root <none> and password file <none>
I20260807 06:55:49.226135 19769 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:49.226287 19769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:49.226652 19769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:49.230104 19769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "43fb632553ab4891952440ad132f273a"
format_stamp: "Formatted at 2026-08-07 06:55:49 on dist-test-slave-tfpf"
server_key: "73a7be9d4acc85dca0bcb9eb42ad45d9"
server_key_iv: "38aa9603a377e30a80d7dab6b277ff0d"
server_key_version: "encryptionkey@0"
I20260807 06:55:49.231024 19769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "43fb632553ab4891952440ad132f273a"
format_stamp: "Formatted at 2026-08-07 06:55:49 on dist-test-slave-tfpf"
server_key: "73a7be9d4acc85dca0bcb9eb42ad45d9"
server_key_iv: "38aa9603a377e30a80d7dab6b277ff0d"
server_key_version: "encryptionkey@0"
I20260807 06:55:49.236841 19769 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 06:55:49.240723 19800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:49.242272 19769 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:49.242475 19769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "43fb632553ab4891952440ad132f273a"
format_stamp: "Formatted at 2026-08-07 06:55:49 on dist-test-slave-tfpf"
server_key: "73a7be9d4acc85dca0bcb9eb42ad45d9"
server_key_iv: "38aa9603a377e30a80d7dab6b277ff0d"
server_key_version: "encryptionkey@0"
I20260807 06:55:49.242727 19769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:49.275321 19769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:49.280351 19769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:49.280675 19769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:49.281774 19769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:49.283116 19769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:49.283193 19769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:49.283280 19769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:49.283334 19769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:49.316900 19769 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:42363
I20260807 06:55:49.316946 19968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:42363 every 8 connection(s)
I20260807 06:55:49.318342 19769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:49.326761 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 19769
I20260807 06:55:49.326977 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:49.327450 11006 external_mini_cluster.cc:1428] Setting key 598d94b760e6aff68a9693c168876ff3
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:49.341009 19972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:49.320959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:38471 (local address 127.10.191.190:40553)
0807 06:55:49.321447 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:49.321451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:49.322464 (+ 1013us) server_negotiation.cc:407] Connection header received
0807 06:55:49.324347 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:49.324352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:49.324447 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:49.324575 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:49.326598 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.327449 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.329390 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.329892 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.330019 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:49.333691 (+ 3672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:49.333701 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:49.333708 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:49.333758 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:49.337610 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:49.338443 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:49.338451 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:49.338457 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:49.338639 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:49.339069 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:49.339075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:49.339081 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:49.339449 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:49.339596 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:49.340272 (+ 676us) server_negotiation.cc:299] Negotiation successful
0807 06:55:49.340531 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":264,"threads_started":1}
I20260807 06:55:49.341733 19974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:49.321539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:40553 (local address 127.10.191.130:38471)
0807 06:55:49.322298 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:49.322338 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:49.324070 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:49.324815 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:49.324823 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:49.325474 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:49.326408 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:49.326439 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.327621 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.327627 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:49.329258 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:49.329274 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.330103 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.330108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:49.330291 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:49.330962 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:49.330992 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:49.333372 (+ 2380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:49.337790 (+ 4418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:49.337797 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:49.337812 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:49.338295 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:49.338762 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:49.338765 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:49.338767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:49.338956 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:49.339563 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:49.339569 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:49.339898 (+ 329us) client_negotiation.cc:769] Sending connection context
0807 06:55:49.340125 (+ 227us) client_negotiation.cc:240] Negotiation successful
0807 06:55:49.340532 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":332,"threads_started":1}
I20260807 06:55:49.343310 19970 heartbeater.cc:347] Connected to a master server at 127.10.191.190:40553
I20260807 06:55:49.343670 19970 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:49.344585 19970 heartbeater.cc:511] Master 127.10.191.190:40553 requested a full tablet report, sending...
I20260807 06:55:49.346359 19490 ts_manager.cc:194] Registered new tserver with Master: 43fb632553ab4891952440ad132f273a (127.10.191.130:42363)
I20260807 06:55:49.347383 19490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:38471
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:55:49.390554 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40553
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:38833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:49.736842 19977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:49.737252 19977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:49.737455 19977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:49.744555 19977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:49.744685 19977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:49.744794 19977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:49.755306 19977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:38833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:40553
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:49.756554 19977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:49.758323 19977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:49.771972 19987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:49.772156 19986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:49.772151 19990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:49.773125 19977 server_base.cc:1034] running on GCE node
I20260807 06:55:49.773773 19977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:49.774742 19977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:49.775942 19977 hybrid_clock.cc:648] HybridClock initialized: now 1786085749775875 us; error 66 us; skew 500 ppm
I20260807 06:55:49.776273 19977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:49.779546 19977 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:55:49.781168 19977 webserver.cc:460] Webserver started at http://127.10.191.131:40555/ using document root <none> and password file <none>
I20260807 06:55:49.781914 19977 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:49.782065 19977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:49.782383 19977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:49.785586 19977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "98ffd5bd8e884d1ba962fb1bd0b0e7ff"
format_stamp: "Formatted at 2026-08-07 06:55:49 on dist-test-slave-tfpf"
server_key: "66a7b98684448099b79c8d04fa32f986"
server_key_iv: "fe1c0dbe30f4e76f7fc6865058387012"
server_key_version: "encryptionkey@0"
I20260807 06:55:49.786401 19977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "98ffd5bd8e884d1ba962fb1bd0b0e7ff"
format_stamp: "Formatted at 2026-08-07 06:55:49 on dist-test-slave-tfpf"
server_key: "66a7b98684448099b79c8d04fa32f986"
server_key_iv: "fe1c0dbe30f4e76f7fc6865058387012"
server_key_version: "encryptionkey@0"
I20260807 06:55:49.791428 19761 heartbeater.cc:503] Master 127.10.191.190:40553 was elected leader, sending a full tablet report...
I20260807 06:55:49.791718 19977 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 06:55:49.795462 19999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:49.796846 19977 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:55:49.797045 19977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "98ffd5bd8e884d1ba962fb1bd0b0e7ff"
format_stamp: "Formatted at 2026-08-07 06:55:49 on dist-test-slave-tfpf"
server_key: "66a7b98684448099b79c8d04fa32f986"
server_key_iv: "fe1c0dbe30f4e76f7fc6865058387012"
server_key_version: "encryptionkey@0"
I20260807 06:55:49.797286 19977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:49.827791 19977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:49.832067 19977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:49.832381 19977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:49.833495 19977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:49.834960 19977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:49.835034 19977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:49.835194 19977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:49.835253 19977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:49.869989 19977 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:42041
I20260807 06:55:49.870031 20154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:42041 every 8 connection(s)
I20260807 06:55:49.871466 19977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:49.880136 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 19977
I20260807 06:55:49.880327 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:49.880915 11006 external_mini_cluster.cc:1428] Setting key 4c8d93acae6eaab39db6a72ed018d3ac
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:55:49.892261 20161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:49.874332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:50021 (local address 127.10.191.190:40553)
0807 06:55:49.874779 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:49.874784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:49.875814 (+ 1030us) server_negotiation.cc:407] Connection header received
0807 06:55:49.877758 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:49.877764 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:49.877874 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:49.878001 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:49.879517 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.880718 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.882564 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.883084 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.883253 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:49.886800 (+ 3547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:49.886804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:49.886807 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:49.886858 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:49.889506 (+ 2648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:49.890248 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:49.890252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:49.890254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:49.890374 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:49.890747 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:49.890750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:49.890752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:49.891002 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:49.891120 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:49.891774 (+ 654us) server_negotiation.cc:299] Negotiation successful
0807 06:55:49.891950 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":209,"threads_started":1}
I20260807 06:55:49.893412 20165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:49.874919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:40553 (local address 127.10.191.131:50021)
0807 06:55:49.875628 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:49.875683 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:49.877454 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:49.878244 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:49.878252 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:49.878783 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:49.879339 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:49.879356 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.880892 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.880896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:49.882423 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:49.882436 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.883357 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.883364 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:49.883624 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:49.884383 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:49.884407 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:49.886548 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:49.889656 (+ 3108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:49.889663 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:49.889677 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:49.890139 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:49.890462 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:49.890465 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:49.890467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:49.890653 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:49.891116 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:49.891122 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:49.891448 (+ 326us) client_negotiation.cc:769] Sending connection context
0807 06:55:49.891674 (+ 226us) client_negotiation.cc:240] Negotiation successful
0807 06:55:49.892106 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":297,"threads_started":1}
I20260807 06:55:49.895103 20155 heartbeater.cc:347] Connected to a master server at 127.10.191.190:40553
I20260807 06:55:49.895442 20155 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:49.896272 20155 heartbeater.cc:511] Master 127.10.191.190:40553 requested a full tablet report, sending...
I20260807 06:55:49.897815 19490 ts_manager.cc:194] Registered new tserver with Master: 98ffd5bd8e884d1ba962fb1bd0b0e7ff (127.10.191.131:42041)
I20260807 06:55:49.898674 19490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:50021
I20260807 06:55:49.909435 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/test-admin.keytab.
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:49.943454 11006 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 06:55:49.949469 20170 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:55:49.946507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57036 (local address 127.10.191.129:36235)
0807 06:55:49.947339 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:49.947350 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:49.947387 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:55:49.947470 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:49.947477 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:49.947750 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:49.947932 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:49.948950 (+ 1018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57036: BlockingRecv error: recv got EOF from 127.0.0.1:57036 (error 108)
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":404,"threads_started":1}
W20260807 06:55:49.949535 11006 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5cc' of type FILE
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:49.951399 11006 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:49.952996 11006 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:49.968639 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:49.954919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57048 (local address 127.10.191.129:36235)
0807 06:55:49.955134 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:49.955138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:49.955520 (+ 382us) server_negotiation.cc:407] Connection header received
0807 06:55:49.955658 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:49.955661 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:49.955723 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:49.955809 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:49.956827 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.957874 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.959036 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.959576 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.959665 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:49.963330 (+ 3665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:49.963343 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:49.963360 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:49.963405 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:49.966227 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:49.966906 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:49.966913 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:49.966915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:49.967034 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:49.967350 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:49.967353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:49.967355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:49.967700 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:49.967911 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:49.968175 (+ 264us) server_negotiation.cc:299] Negotiation successful
0807 06:55:49.968371 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 06:55:49.974429 20170 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:55:49.972612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57064 (local address 127.10.191.129:36235)
0807 06:55:49.972866 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:49.972872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:49.973176 (+ 304us) server_negotiation.cc:407] Connection header received
0807 06:55:49.973315 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:49.973319 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:49.973377 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:49.973456 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:49.974192 (+ 736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57064: BlockingRecv error: recv got EOF from 127.0.0.1:57064 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260807 06:55:49.974550 11006 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5cc' of type FILE
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:49.976008 11006 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:49.977331 11006 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:49.992041 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:49.978634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57066 (local address 127.10.191.129:36235)
0807 06:55:49.978845 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:49.978850 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:49.979122 (+ 272us) server_negotiation.cc:407] Connection header received
0807 06:55:49.979345 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:49.979349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:49.979409 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:49.979514 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:49.980566 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.981348 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.982582 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:49.983062 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:49.983206 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:49.987194 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:49.987200 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:49.987203 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:49.987254 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:49.989842 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:49.990507 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:49.990511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:49.990513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:49.990634 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:49.990950 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:49.990953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:49.990955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:49.991212 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:49.991408 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:49.991617 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 06:55:49.991824 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 06:55:49.996472 20170 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:55:49.994842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57080 (local address 127.10.191.129:36235)
0807 06:55:49.995048 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:49.995054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:49.995200 (+ 146us) server_negotiation.cc:407] Connection header received
0807 06:55:49.995331 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:49.995335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:49.995403 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:49.995487 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:49.996203 (+ 716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57080: BlockingRecv error: recv got EOF from 127.0.0.1:57080 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 06:55:49.996551 11006 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786085696003154-11006-0/krb5kdc/krb5cc' of type FILE
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:49.998272 11006 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 06:55:49 dist-test-slave-tfpf krb5kdc[19422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:49.999480 11006 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 06:55:50 dist-test-slave-tfpf krb5kdc[19422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:55:50.013399 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:50.000835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57090 (local address 127.10.191.129:36235)
0807 06:55:50.001051 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:50.001057 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:50.001398 (+ 341us) server_negotiation.cc:407] Connection header received
0807 06:55:50.001552 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:50.001555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:50.001617 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:50.001709 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:50.002692 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:50.003434 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:50.004576 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:50.004969 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:50.005114 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:50.008522 (+ 3408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:50.008527 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:50.008531 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:50.008566 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:50.011032 (+ 2466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:50.011659 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:50.011670 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:50.011672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:50.011808 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:50.012127 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:50.012130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:50.012132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:50.012389 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:50.012624 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:50.012865 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 06:55:50.013047 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:55:50.015054 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 19574
I20260807 06:55:50.027392 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:50.015749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57104 (local address 127.10.191.129:36235)
0807 06:55:50.015915 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:50.015922 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:50.016209 (+ 287us) server_negotiation.cc:407] Connection header received
0807 06:55:50.016398 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:50.016408 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:50.016468 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:50.016566 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:50.017650 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:50.018291 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:50.019451 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:50.019843 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:50.019971 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:50.022275 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:50.022281 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:50.022284 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:50.022316 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:50.024647 (+ 2331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:50.025406 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:50.025410 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:50.025412 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:50.025545 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:50.026028 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:50.026033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:50.026036 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:50.026375 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:50.026641 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:50.026968 (+ 327us) server_negotiation.cc:299] Negotiation successful
0807 06:55:50.027137 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 06:55:50.028074 19753 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:50.110673 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 19574
I20260807 06:55:50.133857 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 19769
Aug 07 06:55:50 dist-test-slave-tfpf krb5kdc[19422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:55:50.149891 20186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:50.134834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47498 (local address 127.10.191.130:42363)
0807 06:55:50.135413 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:50.135420 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:50.135445 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:55:50.135508 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:50.135515 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:50.135722 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:50.135852 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:50.136789 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:50.137840 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:50.138968 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:50.139470 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:50.139561 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:50.143638 (+ 4077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:50.143651 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:50.143667 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:50.143706 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:50.146841 (+ 3135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:50.147703 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:50.147710 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:50.147712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:50.147853 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:50.148258 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:50.148262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:50.148264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:50.148607 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:50.148837 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:50.149364 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 06:55:50.149584 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":320,"threads_started":1}
I20260807 06:55:50.151249 19964 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:50.234733 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 19769
I20260807 06:55:50.261121 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 19977
Aug 07 06:55:50 dist-test-slave-tfpf krb5kdc[19422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:55:50.277906 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:50.262193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33036 (local address 127.10.191.131:42041)
0807 06:55:50.262823 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:50.262830 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:50.262860 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:55:50.262940 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:50.262947 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:50.263172 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:50.263355 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:50.264478 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:50.265581 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:50.266852 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:50.267420 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:50.267569 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:50.271719 (+ 4150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:50.271732 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:50.271747 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:50.271782 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:50.274967 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:50.275694 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:50.275702 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:50.275704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:50.275845 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:50.276247 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:50.276252 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:50.276257 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:50.276616 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:50.276973 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:50.277319 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 06:55:50.277589 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":320,"threads_started":1}
I20260807 06:55:50.279275 20149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:50.367041 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 19977
I20260807 06:55:50.389317 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 19445
I20260807 06:55:50.390585 19535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:50.496176 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 19445
2026-08-07T06:55:50Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4425 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:55:50 dist-test-slave-tfpf krb5kdc[20196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:55:50 dist-test-slave-tfpf krb5kdc[20196](info): set up 2 sockets
Aug 07 06:55:50 dist-test-slave-tfpf krb5kdc[20196](info): commencing operation
krb5kdc: starting...
W20260807 06:55:51.744882 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:55:51 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:55:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:55:51Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.190.keytab.
Entry for principal oryx/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.190.keytab.
I20260807 06:55:52.030306 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:37753
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.190.keytab
--principal=oryx/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:37753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:52.375283 20212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:52.375644 20212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:52.375834 20212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:52.382890 20212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:52.383096 20212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:52.383184 20212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:52.383294 20212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:52.383364 20212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:52.393006 20212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:37753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.190.keytab
--principal=oryx/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:37753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:52.394634 20212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:52.396108 20212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:52.408419 20222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:52.408823 20221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:52.409010 20224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:52.409497 20212 server_base.cc:1034] running on GCE node
I20260807 06:55:52.410308 20212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:52.411710 20212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:52.412920 20212 hybrid_clock.cc:648] HybridClock initialized: now 1786085752412879 us; error 34 us; skew 500 ppm
I20260807 06:55:52.413378 20212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:52 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085752, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:52.416584 20212 init.cc:377] Logged in from keytab as oryx/127.10.191.190@KRBTEST.COM (short username oryx)
I20260807 06:55:52.418188 20212 webserver.cc:460] Webserver started at http://127.10.191.190:32867/ using document root <none> and password file <none>
I20260807 06:55:52.418908 20212 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:52.419054 20212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:52.419377 20212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:52.422654 20212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03"
format_stamp: "Formatted at 2026-08-07 06:55:52 on dist-test-slave-tfpf"
server_key: "d270aba067f97f0ea0e7f1661f38af5f"
server_key_iv: "05e3d3d4d24432d3ee9f0a27e6ab9761"
server_key_version: "encryptionkey@0"
I20260807 06:55:52.423553 20212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03"
format_stamp: "Formatted at 2026-08-07 06:55:52 on dist-test-slave-tfpf"
server_key: "d270aba067f97f0ea0e7f1661f38af5f"
server_key_iv: "05e3d3d4d24432d3ee9f0a27e6ab9761"
server_key_version: "encryptionkey@0"
I20260807 06:55:52.429495 20212 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260807 06:55:52.433398 20233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:52.434828 20212 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:55:52.435019 20212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03"
format_stamp: "Formatted at 2026-08-07 06:55:52 on dist-test-slave-tfpf"
server_key: "d270aba067f97f0ea0e7f1661f38af5f"
server_key_iv: "05e3d3d4d24432d3ee9f0a27e6ab9761"
server_key_version: "encryptionkey@0"
I20260807 06:55:52.435225 20212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:52.451334 20212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:52.455682 20212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:52.455976 20212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:52.475426 20212 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:37753
I20260807 06:55:52.475459 20302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:37753 every 8 connection(s)
I20260807 06:55:52.476972 20212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:55:52.480154 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 20212
I20260807 06:55:52.480381 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:55:52.480974 20304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:52.481119 11006 external_mini_cluster.cc:1428] Setting key f85a818a4dd355248acddb4c35128575
Aug 07 06:55:52 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:55:52.496368 20304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: Bootstrap starting.
I20260807 06:55:52.500852 20304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:52.502336 20304 log.cc:824] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:52.506239 20304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: No bootstrap required, opened a new log
I20260807 06:55:52.507071 20308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:52.483362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52928 (local address 127.10.191.190:37753)
0807 06:55:52.484241 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:52.484274 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:52.484324 (+ 50us) server_negotiation.cc:407] Connection header received
0807 06:55:52.486366 (+ 2042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:52.486397 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:52.486962 (+ 565us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:52.487407 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:52.488772 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:52.490647 (+ 1875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:52.491829 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:52.492934 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:52.493187 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:52.497549 (+ 4362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:52.497562 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:52.497581 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:52.497637 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:52.502014 (+ 4377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:52.502825 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:52.502836 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:52.502848 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:52.503161 (+ 313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:52.503635 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:52.503638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:52.503640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:52.504409 (+ 769us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:52.504722 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:52.505138 (+ 416us) server_negotiation.cc:299] Negotiation successful
0807 06:55:52.505627 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":374,"threads_started":1}
I20260807 06:55:52.515067 20304 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } }
I20260807 06:55:52.515436 20304 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:52.515513 20304 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f15d78b0aac40c79a4d3cf03f8b9d03, State: Initialized, Role: FOLLOWER
I20260807 06:55:52.516062 20304 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } }
I20260807 06:55:52.516269 20304 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:55:52.516384 20304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:55:52.516518 20304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:52.518913 20304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } }
I20260807 06:55:52.519563 20304 leader_election.cc:302] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f15d78b0aac40c79a4d3cf03f8b9d03; no voters:
I20260807 06:55:52.520219 20304 leader_election.cc:288] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:55:52.520356 20312 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:52.521144 20312 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 1 LEADER]: Becoming Leader. State: Replica: 7f15d78b0aac40c79a4d3cf03f8b9d03, State: Running, Role: LEADER
I20260807 06:55:52.521675 20312 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } }
I20260807 06:55:52.522476 20304 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:52.524840 20313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } }
I20260807 06:55:52.525358 20313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:52.525956 20314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f15d78b0aac40c79a4d3cf03f8b9d03. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } }
I20260807 06:55:52.526340 20314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:52.531070 20317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:52.537514 20317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:52.546782 20317 catalog_manager.cc:1347] Generated new cluster ID: 4c9482d971a9446eaae1b8bde6eaceb5
I20260807 06:55:52.546937 20317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:52.560940 20317 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:55:52.562722 20317 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:52.573800 20317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: Generated new TSK 0
I20260807 06:55:52.574800 20317 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab.
Entry for principal oryx/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab.
I20260807 06:55:52.658792 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37753
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab
--principal=oryx/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:53.010861 20337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:53.011157 20337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:53.011250 20337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:53.018668 20337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:53.018798 20337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:53.018986 20337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:53.028904 20337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab
--principal=oryx/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:53.030252 20337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:53.031646 20337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:53.045008 20344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:53.045046 20343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:53.045107 20348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:53.045837 20337 server_base.cc:1034] running on GCE node
I20260807 06:55:53.046482 20337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:53.047502 20337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:53.048764 20337 hybrid_clock.cc:648] HybridClock initialized: now 1786085753048711 us; error 44 us; skew 500 ppm
I20260807 06:55:53.049191 20337 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:53 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085753, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:53.057633 20337 init.cc:377] Logged in from keytab as oryx/127.10.191.129@KRBTEST.COM (short username oryx)
I20260807 06:55:53.059255 20337 webserver.cc:460] Webserver started at http://127.10.191.129:38655/ using document root <none> and password file <none>
I20260807 06:55:53.059980 20337 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:53.060084 20337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:53.060362 20337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:53.063635 20337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "c8646bd931bb404abe5167e704296b3e"
format_stamp: "Formatted at 2026-08-07 06:55:53 on dist-test-slave-tfpf"
server_key: "6e373945e7889cfdf8c4e7b4ef175fe8"
server_key_iv: "1a77a94e7acdfadece0d52659bafe415"
server_key_version: "encryptionkey@0"
I20260807 06:55:53.064429 20337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "c8646bd931bb404abe5167e704296b3e"
format_stamp: "Formatted at 2026-08-07 06:55:53 on dist-test-slave-tfpf"
server_key: "6e373945e7889cfdf8c4e7b4ef175fe8"
server_key_iv: "1a77a94e7acdfadece0d52659bafe415"
server_key_version: "encryptionkey@0"
I20260807 06:55:53.069784 20337 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 06:55:53.073277 20356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:53.074792 20337 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:55:53.074954 20337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "c8646bd931bb404abe5167e704296b3e"
format_stamp: "Formatted at 2026-08-07 06:55:53 on dist-test-slave-tfpf"
server_key: "6e373945e7889cfdf8c4e7b4ef175fe8"
server_key_iv: "1a77a94e7acdfadece0d52659bafe415"
server_key_version: "encryptionkey@0"
I20260807 06:55:53.075132 20337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:53.089282 20337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:53.093562 20337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:53.093863 20337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:53.094846 20337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:53.096195 20337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:53.096267 20337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:53.096350 20337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:53.096395 20337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:53.131016 20337 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:33051
I20260807 06:55:53.131038 20501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:33051 every 8 connection(s)
I20260807 06:55:53.132792 20337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:53.138761 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 20337
I20260807 06:55:53.138998 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:55:53.139813 11006 external_mini_cluster.cc:1428] Setting key 441d136fcda2b6d7d2eecd9ec53d75c2
Aug 07 06:55:53 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085753, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:55:53.154146 20506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:53.135776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:60909 (local address 127.10.191.190:37753)
0807 06:55:53.136261 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:53.136266 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:53.137282 (+ 1016us) server_negotiation.cc:407] Connection header received
0807 06:55:53.139574 (+ 2292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:53.139580 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:53.139692 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:53.139816 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:53.141424 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:53.142185 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:53.143815 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:53.144223 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:53.144397 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:53.147954 (+ 3557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:53.147959 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:53.147962 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:53.148014 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:53.150710 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:53.151452 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:53.151457 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:53.151459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:53.151575 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:53.152029 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:53.152034 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:53.152038 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:53.152398 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:53.152568 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:53.153386 (+ 818us) server_negotiation.cc:299] Negotiation successful
0807 06:55:53.153671 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":266,"threads_started":1}
I20260807 06:55:53.154980 20508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:53.136283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.129:60909)
0807 06:55:53.137047 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:53.137145 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:53.139255 (+ 2110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:53.140067 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:53.140075 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:53.140613 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:53.141253 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:53.141274 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:53.142355 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:53.142359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:53.143645 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:53.143658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:53.144489 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:53.144498 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:53.144740 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:53.145479 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:53.145501 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:53.147696 (+ 2195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:53.150867 (+ 3171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:53.150877 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:53.150894 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:53.151316 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:53.151691 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:53.151696 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:53.151699 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:53.151905 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:53.152545 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:53.152551 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:53.152880 (+ 329us) client_negotiation.cc:769] Sending connection context
0807 06:55:53.153220 (+ 340us) client_negotiation.cc:240] Negotiation successful
0807 06:55:53.153742 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":301,"threads_started":1}
I20260807 06:55:53.156620 20502 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37753
I20260807 06:55:53.157012 20502 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:53.158004 20502 heartbeater.cc:511] Master 127.10.191.190:37753 requested a full tablet report, sending...
I20260807 06:55:53.160440 20255 ts_manager.cc:194] Registered new tserver with Master: c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051)
I20260807 06:55:53.161973 20255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:60909
WARNING: no policy specified for oryx/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab.
Entry for principal oryx/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab.
I20260807 06:55:53.204018 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37753
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab
--principal=oryx/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:53.555171 20511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:53.555522 20511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:53.555680 20511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:53.562758 20511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:53.562917 20511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:53.563099 20511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:53.572759 20511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab
--principal=oryx/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:53.574275 20511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:53.575623 20511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:53.589744 20517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:53.589727 20518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:53.589747 20523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:53.590512 20511 server_base.cc:1034] running on GCE node
I20260807 06:55:53.591202 20511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:53.592195 20511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:53.593416 20511 hybrid_clock.cc:648] HybridClock initialized: now 1786085753593375 us; error 65 us; skew 500 ppm
I20260807 06:55:53.593776 20511 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:53 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085753, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:53.597216 20511 init.cc:377] Logged in from keytab as oryx/127.10.191.130@KRBTEST.COM (short username oryx)
I20260807 06:55:53.598785 20511 webserver.cc:460] Webserver started at http://127.10.191.130:37945/ using document root <none> and password file <none>
I20260807 06:55:53.599570 20511 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:53.599716 20511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:53.600069 20511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:53.603238 20511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "dee1f504ab3b4a02a1e465ea780a3b9c"
format_stamp: "Formatted at 2026-08-07 06:55:53 on dist-test-slave-tfpf"
server_key: "b27365a163ca4afef7b92a36b7069ae6"
server_key_iv: "5e2463ae3abf8c59534397cdb552ee2a"
server_key_version: "encryptionkey@0"
I20260807 06:55:53.604091 20511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "dee1f504ab3b4a02a1e465ea780a3b9c"
format_stamp: "Formatted at 2026-08-07 06:55:53 on dist-test-slave-tfpf"
server_key: "b27365a163ca4afef7b92a36b7069ae6"
server_key_iv: "5e2463ae3abf8c59534397cdb552ee2a"
server_key_version: "encryptionkey@0"
I20260807 06:55:53.609529 20511 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 06:55:53.613382 20532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:53.614869 20511 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:55:53.615059 20511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "dee1f504ab3b4a02a1e465ea780a3b9c"
format_stamp: "Formatted at 2026-08-07 06:55:53 on dist-test-slave-tfpf"
server_key: "b27365a163ca4afef7b92a36b7069ae6"
server_key_iv: "5e2463ae3abf8c59534397cdb552ee2a"
server_key_version: "encryptionkey@0"
I20260807 06:55:53.615289 20511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:53.631042 20511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:53.635857 20511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:53.636188 20511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:53.637338 20511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:53.638876 20511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:53.638996 20511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:53.639137 20511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:53.639209 20511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:53.672721 20511 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:45945
I20260807 06:55:53.672768 20700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:45945 every 8 connection(s)
I20260807 06:55:53.674201 20511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:53.684505 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 20511
I20260807 06:55:53.684703 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:55:53.685289 11006 external_mini_cluster.cc:1428] Setting key 98594f8b49e060d4dd93001c9d2cb0cc
Aug 07 06:55:53 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085753, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:55:53.695645 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:53.677026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:56053 (local address 127.10.191.190:37753)
0807 06:55:53.677548 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:53.677553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:53.678499 (+ 946us) server_negotiation.cc:407] Connection header received
0807 06:55:53.680456 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:53.680462 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:53.680556 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:53.680673 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:53.682288 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:53.682976 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:53.684964 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:53.685495 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:53.685601 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:53.689844 (+ 4243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:53.689849 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:53.689851 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:53.689883 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:53.692231 (+ 2348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:53.693164 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:53.693167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:53.693169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:53.693318 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:53.693841 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:53.693844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:53.693846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:53.694106 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:53.694228 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:53.695208 (+ 980us) server_negotiation.cc:299] Negotiation successful
0807 06:55:53.695380 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":258,"threads_started":1}
I20260807 06:55:53.697211 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:53.677566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.130:56053)
0807 06:55:53.678300 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:53.678344 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:53.680179 (+ 1835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:53.680920 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:53.680929 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:53.681540 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:53.682114 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:53.682130 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:53.683153 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:53.683157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:53.684791 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:53.684808 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:53.685750 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:53.685759 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:53.686049 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:53.686842 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:53.686864 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:53.689602 (+ 2738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:53.692384 (+ 2782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:53.692395 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:53.692413 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:53.693008 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:53.693430 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:53.693437 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:53.693443 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:53.693725 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:53.694244 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:53.694255 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:53.694806 (+ 551us) client_negotiation.cc:769] Sending connection context
0807 06:55:53.695112 (+ 306us) client_negotiation.cc:240] Negotiation successful
0807 06:55:53.695710 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":280,"threads_started":1}
I20260807 06:55:53.698731 20702 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37753
I20260807 06:55:53.699120 20702 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:53.699956 20702 heartbeater.cc:511] Master 127.10.191.190:37753 requested a full tablet report, sending...
I20260807 06:55:53.701588 20255 ts_manager.cc:194] Registered new tserver with Master: dee1f504ab3b4a02a1e465ea780a3b9c (127.10.191.130:45945)
I20260807 06:55:53.702378 20255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:56053
WARNING: no policy specified for oryx/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab.
Entry for principal oryx/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab.
I20260807 06:55:53.748100 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37753
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab
--principal=oryx/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:54.091527 20708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:54.091913 20708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:54.092093 20708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:54.099525 20708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:54.099756 20708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:54.099969 20708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:54.109534 20708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab
--principal=oryx/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:54.110893 20708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:54.112249 20708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:54.126102 20715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:54.126133 20716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:54.126304 20720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:54.127439 20708 server_base.cc:1034] running on GCE node
I20260807 06:55:54.128124 20708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:54.129196 20708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:54.130445 20708 hybrid_clock.cc:648] HybridClock initialized: now 1786085754130369 us; error 58 us; skew 500 ppm
I20260807 06:55:54.130820 20708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:54 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085754, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:54.134851 20708 init.cc:377] Logged in from keytab as oryx/127.10.191.131@KRBTEST.COM (short username oryx)
I20260807 06:55:54.137720 20708 webserver.cc:460] Webserver started at http://127.10.191.131:34673/ using document root <none> and password file <none>
I20260807 06:55:54.138520 20708 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:54.138674 20708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:54.139000 20708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:54.142105 20708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "6d7f9c5340984028adb8636ff0e3faec"
format_stamp: "Formatted at 2026-08-07 06:55:54 on dist-test-slave-tfpf"
server_key: "ff1daaf723611f9bb027de5421f949b5"
server_key_iv: "03cd4ca319810f93e96641ec44fa4e93"
server_key_version: "encryptionkey@0"
I20260807 06:55:54.143031 20708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "6d7f9c5340984028adb8636ff0e3faec"
format_stamp: "Formatted at 2026-08-07 06:55:54 on dist-test-slave-tfpf"
server_key: "ff1daaf723611f9bb027de5421f949b5"
server_key_iv: "03cd4ca319810f93e96641ec44fa4e93"
server_key_version: "encryptionkey@0"
I20260807 06:55:54.148540 20708 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:55:54.152272 20732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:54.153743 20708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 06:55:54.153940 20708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "6d7f9c5340984028adb8636ff0e3faec"
format_stamp: "Formatted at 2026-08-07 06:55:54 on dist-test-slave-tfpf"
server_key: "ff1daaf723611f9bb027de5421f949b5"
server_key_iv: "03cd4ca319810f93e96641ec44fa4e93"
server_key_version: "encryptionkey@0"
I20260807 06:55:54.154182 20708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:54.166244 20502 heartbeater.cc:503] Master 127.10.191.190:37753 was elected leader, sending a full tablet report...
I20260807 06:55:54.176643 20708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:54.180876 20708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:54.181190 20708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:54.182130 20708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:54.183423 20708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:54.183502 20708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:54.183590 20708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:54.183635 20708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:54.216607 20708 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:44405
I20260807 06:55:54.216706 20884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:44405 every 8 connection(s)
I20260807 06:55:54.218096 20708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:54.228374 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 20708
I20260807 06:55:54.228586 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:55:54.229182 11006 external_mini_cluster.cc:1428] Setting key d53780dd094b35b19a0df47e0bd3639f
Aug 07 06:55:54 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085754, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:55:54.239442 20889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.220938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:55837 (local address 127.10.191.190:37753)
0807 06:55:54.221432 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:54.221436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:54.222571 (+ 1135us) server_negotiation.cc:407] Connection header received
0807 06:55:54.224616 (+ 2045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:54.224621 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:54.224722 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:54.224843 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:54.226381 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.227168 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.228659 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.229312 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.229465 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.233646 (+ 4181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:54.233651 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:54.233655 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:54.233690 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:54.236354 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.237179 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.237183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.237186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.237305 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.237701 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.237705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.237707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.237976 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:54.238100 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:54.238861 (+ 761us) server_negotiation.cc:299] Negotiation successful
0807 06:55:54.239054 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":260,"threads_started":1}
I20260807 06:55:54.240410 20890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.221572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.131:55837)
0807 06:55:54.222376 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:54.222458 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:54.224301 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:54.225122 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:54.225139 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:54.225648 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:54.226210 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.226227 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.227329 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.227339 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.228475 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.228488 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.229551 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.229556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.229816 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.230616 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:54.230649 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:54.233427 (+ 2778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:54.236499 (+ 3072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.236507 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.236522 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.236997 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.237399 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.237403 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.237405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.237599 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.238089 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:54.238095 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:54.238447 (+ 352us) client_negotiation.cc:769] Sending connection context
0807 06:55:54.238747 (+ 300us) client_negotiation.cc:240] Negotiation successful
0807 06:55:54.239174 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":295,"threads_started":1}
I20260807 06:55:54.241930 20885 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37753
I20260807 06:55:54.242259 20885 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:54.243074 20885 heartbeater.cc:511] Master 127.10.191.190:37753 requested a full tablet report, sending...
I20260807 06:55:54.244865 20255 ts_manager.cc:194] Registered new tserver with Master: 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405)
I20260807 06:55:54.245483 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:55:54.245841 20255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:55837
WARNING: no policy specified for oryx/127.10.191.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.189.keytab.
Entry for principal oryx/127.10.191.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.189.keytab.
I20260807 06:55:54.307917 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.189:38837
--webserver_interface=127.10.191.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.189.keytab
--principal=oryx/127.10.191.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:37753,127.10.191.189:38837
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:54.655627 20893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:54.655927 20893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:54.656100 20893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:54.663923 20893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:54.664057 20893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:54.664145 20893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:54.664250 20893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:54.664328 20893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:54.675558 20893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:37753,127.10.191.189:38837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.189.keytab
--principal=oryx/127.10.191.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.189:38837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.191.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
W20260807 06:55:54.675968 20893 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.10.191.190:37753,127.10.191.189:38837'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 06:55:54.677304 20893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:54.679111 20893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:54.690936 20899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:54.690960 20903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:54.690917 20901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:54.691557 20893 server_base.cc:1034] running on GCE node
I20260807 06:55:54.692451 20893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:54.694022 20893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:54.695287 20893 hybrid_clock.cc:648] HybridClock initialized: now 1786085754695221 us; error 41 us; skew 500 ppm
I20260807 06:55:54.695644 20893 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:54 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085754, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:54.698877 20893 init.cc:377] Logged in from keytab as oryx/127.10.191.189@KRBTEST.COM (short username oryx)
I20260807 06:55:54.700403 20893 webserver.cc:460] Webserver started at http://127.10.191.189:44397/ using document root <none> and password file <none>
I20260807 06:55:54.701200 20893 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:54.701332 20893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:54.701663 20893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:54.704818 20893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data/instance:
uuid: "3ed91052c0ce4d28aede4dcc49a6ddff"
format_stamp: "Formatted at 2026-08-07 06:55:54 on dist-test-slave-tfpf"
server_key: "332232491c770e7173c90469481f57f3"
server_key_iv: "8534fb8a708bde7b4c25b7799d5cf33d"
server_key_version: "encryptionkey@0"
I20260807 06:55:54.705794 20893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal/instance:
uuid: "3ed91052c0ce4d28aede4dcc49a6ddff"
format_stamp: "Formatted at 2026-08-07 06:55:54 on dist-test-slave-tfpf"
server_key: "332232491c770e7173c90469481f57f3"
server_key_iv: "8534fb8a708bde7b4c25b7799d5cf33d"
server_key_version: "encryptionkey@0"
I20260807 06:55:54.706041 20702 heartbeater.cc:503] Master 127.10.191.190:37753 was elected leader, sending a full tablet report...
I20260807 06:55:54.711607 20893 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260807 06:55:54.715176 20911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:54.716465 20893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:55:54.716641 20893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal
uuid: "3ed91052c0ce4d28aede4dcc49a6ddff"
format_stamp: "Formatted at 2026-08-07 06:55:54 on dist-test-slave-tfpf"
server_key: "332232491c770e7173c90469481f57f3"
server_key_iv: "8534fb8a708bde7b4c25b7799d5cf33d"
server_key_version: "encryptionkey@0"
I20260807 06:55:54.716905 20893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:54.748270 20893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:54.752346 20893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:54.752566 20893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:54.771389 20893 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.189:38837
I20260807 06:55:54.771409 20984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.189:38837 every 8 connection(s)
I20260807 06:55:54.772881 20893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
I20260807 06:55:54.777302 20985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:54.777674 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 20893
I20260807 06:55:54.786156 20985 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:55:54 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.189@KRBTEST.COM
Aug 07 06:55:54 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085754, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.189@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:55:54.802858 20988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.780732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41344 (local address 127.10.191.189:38837)
0807 06:55:54.781580 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:54.781592 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:54.781635 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:55:54.783498 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:54.783523 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:54.783965 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:54.784424 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:54.786279 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.787624 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.789062 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.789889 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.790081 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.794753 (+ 4672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:54.794782 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:54.794795 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:54.794854 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:54.798228 (+ 3374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.798930 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.798942 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.798952 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.799161 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.799603 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.799609 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.799613 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.800379 (+ 766us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:54.800655 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:54.801107 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 06:55:54.801536 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":416,"threads_started":1}
I20260807 06:55:54.804832 20989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.788717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52942 (local address 127.10.191.190:37753)
0807 06:55:54.789238 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:54.789243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:54.789813 (+ 570us) server_negotiation.cc:407] Connection header received
0807 06:55:54.789998 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:54.790004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:54.790086 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:54.790202 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:54.791598 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.792265 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.793939 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.794620 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.794710 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.798579 (+ 3869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:54.798584 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:54.798586 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:54.798622 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:54.801807 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.802574 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.802578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.802581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.802719 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.803151 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.803156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.803158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.803536 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:54.803739 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:54.804198 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 06:55:54.804437 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":248,"threads_started":1}
I20260807 06:55:54.804886 20990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.788721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:52942)
0807 06:55:54.789659 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:54.789708 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:54.789858 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:54.790283 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:54.790289 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:54.791113 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:54.791436 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.791451 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.792403 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.792408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.793786 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.793799 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.794795 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.794800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.795020 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.795680 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:54.795701 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:54.798394 (+ 2693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:54.801952 (+ 3558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.801961 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.801965 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.802421 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.802824 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.802827 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.802829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.802986 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.803683 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:54.803691 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:54.803883 (+ 192us) client_negotiation.cc:769] Sending connection context
0807 06:55:54.804081 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 06:55:54.804431 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":549,"threads_started":1}
I20260807 06:55:54.806766 20985 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:55:54 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085754, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.189@KRBTEST.COM for oryx/127.10.191.189@KRBTEST.COM
I20260807 06:55:54.818276 20990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.807565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.0.0.1:41360)
0807 06:55:54.807780 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:54.807793 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:54.807873 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:54.808143 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:54.808146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:54.808440 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:54.808567 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.808574 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.809502 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.809505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.810297 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.810307 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.810895 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.810898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.811021 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.811519 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:54.811534 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:54.813423 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:54.816203 (+ 2780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.816207 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.816209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.816550 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.816884 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.816887 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.816889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.817008 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.817561 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:54.817565 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:54.817684 (+ 119us) client_negotiation.cc:769] Sending connection context
0807 06:55:54.817787 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 06:55:54.817984 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157}
I20260807 06:55:54.818353 20988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.807570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41360 (local address 127.10.191.189:38837)
0807 06:55:54.807712 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:54.807715 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:54.807854 (+ 139us) server_negotiation.cc:407] Connection header received
0807 06:55:54.807970 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:54.807974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:54.808026 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:54.808095 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:54.808681 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.809383 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.810413 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.810772 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.810860 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.813590 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:54.813595 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:54.813598 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:54.813627 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:54.816086 (+ 2459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.816644 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.816648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.816650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.816790 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.817172 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.817175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.817177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.817464 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:54.817573 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:54.817882 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 06:55:54.818090 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":51}
I20260807 06:55:54.823843 20985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Bootstrap starting.
I20260807 06:55:54.827148 20985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:54.828245 20985 log.cc:824] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:54.830946 20985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: No bootstrap required, opened a new log
I20260807 06:55:54.837877 20985 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } }
I20260807 06:55:54.838274 20985 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:54.838368 20985 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed91052c0ce4d28aede4dcc49a6ddff, State: Initialized, Role: FOLLOWER
I20260807 06:55:54.839012 20985 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } }
I20260807 06:55:54.840003 20993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } } }
I20260807 06:55:54.840395 20993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:55:54.841140 20985 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: configured and running, proceeding with master startup.
W20260807 06:55:54.849788 21007 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:55:54.849937 21007 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:55:54.852839 20893 master_runner.cc:428] Detected that this master 3ed91052c0ce4d28aede4dcc49a6ddff is joining an existing cluster
I20260807 06:55:54.852934 20893 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.191.189:38837
I20260807 06:55:54.886026 20989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.857034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.10.191.190:37753)
0807 06:55:54.857290 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:54.857299 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:54.869786 (+ 12487us) server_negotiation.cc:407] Connection header received
0807 06:55:54.870065 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:54.870072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:54.870178 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:54.870252 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:54.872054 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.873214 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.875627 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.876323 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.876442 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.879103 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:54.879110 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:54.879117 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:54.879162 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:54.882675 (+ 3513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.883640 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.883645 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.883648 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.883804 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.884301 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.884306 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.884309 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.884695 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:54.884816 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:54.885468 (+ 652us) server_negotiation.cc:299] Negotiation successful
0807 06:55:54.885702 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 06:55:54.886055 20988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.857846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41376 (local address 127.10.191.189:38837)
0807 06:55:54.858045 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:54.858050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:54.869511 (+ 11461us) server_negotiation.cc:407] Connection header received
0807 06:55:54.869979 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:54.869987 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:54.870080 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:54.870148 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:54.872031 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.873209 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.875375 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.876033 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.876171 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.879036 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:54.879042 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:54.879046 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:54.879078 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:54.882675 (+ 3597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.883633 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.883638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.883641 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.883813 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.884286 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.884291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.884293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.884703 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:54.884827 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:54.885457 (+ 630us) server_negotiation.cc:299] Negotiation successful
0807 06:55:54.885696 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 06:55:54.887185 21015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.857029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.0.0.1:41376)
0807 06:55:54.869358 (+ 12329us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:54.869391 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:54.869842 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:54.870360 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:54.870366 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:54.871324 (+ 958us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:54.871882 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.871898 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.873479 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.873487 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.875208 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.875222 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.876454 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.876462 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.876632 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.877424 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:54.877450 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:54.878858 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:54.882823 (+ 3965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.882828 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.882832 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.883494 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.883951 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.883956 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.883960 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.884168 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.884910 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:54.884914 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:54.885181 (+ 267us) client_negotiation.cc:769] Sending connection context
0807 06:55:54.886330 (+ 1149us) client_negotiation.cc:240] Negotiation successful
0807 06:55:54.886660 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12065,"mutex_wait_us":171,"spinlock_wait_cycles":62976,"thread_start_us":12453,"threads_started":1}
I20260807 06:55:54.887642 21016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.858230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:52952)
0807 06:55:54.869641 (+ 11411us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:54.869662 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:54.869905 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:54.870490 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:54.870494 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:54.871438 (+ 944us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:54.871851 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.871865 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.873481 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.873490 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.875460 (+ 1970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.875479 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.876693 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.876700 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.876901 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.877586 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:54.877604 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:54.878908 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:54.882823 (+ 3915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.882828 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.882832 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.883494 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.883951 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.883956 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.883960 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.884168 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.884910 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:54.884914 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:54.885185 (+ 271us) client_negotiation.cc:769] Sending connection context
0807 06:55:54.886594 (+ 1409us) client_negotiation.cc:240] Negotiation successful
0807 06:55:54.886916 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11275,"mutex_wait_us":18,"spinlock_wait_cycles":87680,"thread_start_us":11081,"threads_started":1}
WARNING: no policy specified for oryx/127.10.191.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.188@KRBTEST.COM" created.
Aug 07 06:55:54 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085752, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.190@KRBTEST.COM for oryx/127.10.191.189@KRBTEST.COM
I20260807 06:55:54.913275 20988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.894503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41380 (local address 127.10.191.189:38837)
0807 06:55:54.894721 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:54.894729 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:54.895622 (+ 893us) server_negotiation.cc:407] Connection header received
0807 06:55:54.895979 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:54.895984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:54.896093 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:54.896203 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:54.897526 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.898721 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.900586 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.901279 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.901371 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.905906 (+ 4535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:54.905913 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:54.905918 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:54.905959 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:54.909654 (+ 3695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.910635 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.910640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.910644 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.910840 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:54.911339 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:54.911344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:54.911347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:54.911771 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:54.911959 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:54.912592 (+ 633us) server_negotiation.cc:299] Negotiation successful
0807 06:55:54.912854 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:55:54.913481 21019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:54.894597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.0.0.1:41380)
0807 06:55:54.895482 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:54.895517 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:54.895755 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:54.896260 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:54.896267 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:54.896964 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:54.897321 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.897338 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.898869 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.898874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.900407 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:54.900425 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:54.901449 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:54.901455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:54.901723 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:54.902414 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:54.902444 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:54.905672 (+ 3228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:54.909831 (+ 4159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.909848 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.909859 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.910491 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.910980 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:54.910987 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:54.910993 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:54.911207 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:54.911958 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:54.911970 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:54.912224 (+ 254us) client_negotiation.cc:769] Sending connection context
0807 06:55:54.912463 (+ 239us) client_negotiation.cc:240] Negotiation successful
0807 06:55:54.912876 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":294,"threads_started":1}
I20260807 06:55:54.915962 20255 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.191.189:38837: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff"
member_type: NON_VOTER
last_known_addr {
host: "127.10.191.189"
port: 38837
}
attrs {
promote: true
}
}
dest_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03"
cas_config_opid_index: -1
I20260807 06:55:54.917120 20255 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } }
I20260807 06:55:54.930315 21023 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3ed91052c0ce4d28aede4dcc49a6ddff (127.10.191.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:54.931559 20946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:54.935976 20946 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Refusing update from remote peer 7f15d78b0aac40c79a4d3cf03f8b9d03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 06:55:54.937479 21025 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:54.948953 21023 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.191.189:38837
I20260807 06:55:54.950708 21025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:54.951009 21025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:54.951781 20893 master.cc:537] Master@127.10.191.189:38837 shutting down...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.188.keytab.
Entry for principal oryx/127.10.191.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.188.keytab.
I20260807 06:55:54.957139 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.188:36009
--webserver_interface=127.10.191.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.188.keytab
--principal=oryx/127.10.191.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:37753,127.10.191.189:38837,127.10.191.188:36009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:55:54.977578 20946 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3ed91052c0ce4d28aede4dcc49a6ddff (127.10.191.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:54.982398 21035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:54.982913 21035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: LEARNER
I20260807 06:55:54.982977 21029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:54.983278 21029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: LEARNER
I20260807 06:55:54.983497 20993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f15d78b0aac40c79a4d3cf03f8b9d03. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:54.983642 20993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: LEARNER
I20260807 06:55:55.007954 20893 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 LEARNER]: Raft consensus shutting down.
I20260807 06:55:55.008548 20893 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 LEARNER]: Raft consensus is shut down!
I20260807 06:55:55.008749 20893 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: stopping tablet replica
I20260807 06:55:55.017346 20893 master.cc:552] Master@127.10.191.189:38837 shutdown complete.
I20260807 06:55:55.017495 20893 master_runner.cc:305] Clearing existing system tablet
I20260807 06:55:55.017951 20893 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:55.018066 20893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:55.022768 20893 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 06:55:55.024900 21038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:55.025318 20893 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:55.025626 20893 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260807 06:55:55.025710 20893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal
uuid: "3ed91052c0ce4d28aede4dcc49a6ddff"
format_stamp: "Formatted at 2026-08-07 06:55:54 on dist-test-slave-tfpf"
server_key: "332232491c770e7173c90469481f57f3"
server_key_iv: "8534fb8a708bde7b4c25b7799d5cf33d"
server_key_version: "encryptionkey@0"
I20260807 06:55:55.030431 20893 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:55.037489 20893 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 06:55:55.037698 20893 log.cc:1196] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 06:55:55.038254 20893 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Deleting consensus metadata
I20260807 06:55:55.038533 20893 master_runner.cc:315] Copying system tablet from 127.10.191.190:37753
I20260807 06:55:55.049453 20893 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: tablet copy: Beginning tablet copy session from remote peer at address 127.10.191.190:37753
I20260807 06:55:55.066632 20989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.050405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52960 (local address 127.10.191.190:37753)
0807 06:55:55.050608 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.050614 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.051227 (+ 613us) server_negotiation.cc:407] Connection header received
0807 06:55:55.051418 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.051424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.051526 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.051641 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.052704 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.054015 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.055843 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.056504 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.056631 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.059594 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.059600 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.059605 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.059645 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.063337 (+ 3692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.064259 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.064265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.064269 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.064454 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.064918 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.064923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.064925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.065359 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.065524 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.065993 (+ 469us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.066252 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:55:55.066712 21047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.050354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:52960)
0807 06:55:55.051079 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.051104 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.051282 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.051688 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.051693 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.052233 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:55.052526 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.052539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.054188 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.054194 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.055649 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.055670 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.056668 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.056684 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.056891 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.057659 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:55.057682 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:55.059374 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:55.063519 (+ 4145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.063528 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.063537 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.064112 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.064592 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.064597 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.064601 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.064776 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.065501 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:55.065506 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:55.065676 (+ 170us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.065855 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.066236 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":422,"threads_started":1}
I20260807 06:55:55.068361 20282 tablet_copy_service.cc:140] P 7f15d78b0aac40c79a4d3cf03f8b9d03: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3ed91052c0ce4d28aede4dcc49a6ddff ({username='oryx', principal='oryx/127.10.191.189@KRBTEST.COM'} at 127.0.0.1:52960)
I20260807 06:55:55.068765 20282 tablet_copy_service.cc:161] P 7f15d78b0aac40c79a4d3cf03f8b9d03: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3ed91052c0ce4d28aede4dcc49a6ddff at {username='oryx', principal='oryx/127.10.191.189@KRBTEST.COM'} at 127.0.0.1:52960: session id = 3ed91052c0ce4d28aede4dcc49a6ddff-00000000000000000000000000000000
I20260807 06:55:55.073638 20282 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 06:55:55.076025 20893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 06:55:55.082795 20893 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: tablet copy: Starting download of 0 data blocks...
I20260807 06:55:55.083132 20893 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: tablet copy: Starting download of 1 WAL segments...
I20260807 06:55:55.086508 20893 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 06:55:55.091239 20282 tablet_copy_service.cc:342] P 7f15d78b0aac40c79a4d3cf03f8b9d03: Request end of tablet copy session 3ed91052c0ce4d28aede4dcc49a6ddff-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.191.189@KRBTEST.COM'} at 127.0.0.1:52960
I20260807 06:55:55.091482 20282 tablet_copy_service.cc:433] P 7f15d78b0aac40c79a4d3cf03f8b9d03: ending tablet copy session 3ed91052c0ce4d28aede4dcc49a6ddff-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3ed91052c0ce4d28aede4dcc49a6ddff
I20260807 06:55:55.103545 20893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:55.106372 21048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:55.110478 21049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:55.117343 21051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:55.118074 20893 server_base.cc:1034] running on GCE node
I20260807 06:55:55.118505 20893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:55.119248 20893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:55.120460 20893 hybrid_clock.cc:648] HybridClock initialized: now 1786085755120403 us; error 35 us; skew 500 ppm
I20260807 06:55:55.120663 20893 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:55 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085755, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:55.122937 20893 init.cc:377] Logged in from keytab as oryx/127.10.191.189@KRBTEST.COM (short username oryx)
I20260807 06:55:55.126050 20893 webserver.cc:460] Webserver started at http://127.10.191.189:43251/ using document root <none> and password file <none>
I20260807 06:55:55.126406 20893 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:55.126488 20893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:55.129665 20893 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.002s
I20260807 06:55:55.137603 21059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:55.138178 20893 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.007s
I20260807 06:55:55.138334 20893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal
uuid: "3ed91052c0ce4d28aede4dcc49a6ddff"
format_stamp: "Formatted at 2026-08-07 06:55:54 on dist-test-slave-tfpf"
server_key: "332232491c770e7173c90469481f57f3"
server_key_iv: "8534fb8a708bde7b4c25b7799d5cf33d"
server_key_version: "encryptionkey@0"
I20260807 06:55:55.138520 20893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:55.159289 20893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:55.163723 20893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:55.192768 20893 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.189:38837
I20260807 06:55:55.192934 21125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.189:38837 every 8 connection(s)
I20260807 06:55:55.193928 20893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
I20260807 06:55:55.199766 21129 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:55:55.204078 21129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Bootstrap starting.
I20260807 06:55:55.220541 21129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:55:55.221388 21129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Bootstrap complete.
I20260807 06:55:55.223019 21129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } }
I20260807 06:55:55.223459 21129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3ed91052c0ce4d28aede4dcc49a6ddff, State: Initialized, Role: LEARNER
I20260807 06:55:55.223875 21129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } }
I20260807 06:55:55.224877 21134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:55.225301 21134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: LEARNER
I20260807 06:55:55.225340 21129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:55.234480 21149 catalog_manager.cc:1259] Loaded cluster ID: 4c9482d971a9446eaae1b8bde6eaceb5
I20260807 06:55:55.234622 21149 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: loading cluster ID for follower catalog manager: success
I20260807 06:55:55.238415 21149 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: acquiring CA information for follower catalog manager: success
I20260807 06:55:55.241190 21149 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:55:55.248777 20885 heartbeater.cc:503] Master 127.10.191.190:37753 was elected leader, sending a full tablet report...
W20260807 06:55:55.381582 21034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:55.381987 21034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:55.382161 21034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:55.389345 21034 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:55:55.389503 21034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:55.389613 21034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:55.389730 21034 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:55:55.389809 21034 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:55:55.399983 21034 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:37753,127.10.191.189:38837,127.10.191.188:36009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.188.keytab
--principal=oryx/127.10.191.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.188:36009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.191.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:55.401557 21034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:55.402877 21034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:55.415169 21156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:55.415271 21155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:55.415648 21159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:55.416021 21034 server_base.cc:1034] running on GCE node
I20260807 06:55:55.416935 21034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:55.416857 21023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:55.417182 21023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:55.419131 21034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:55.420403 21034 hybrid_clock.cc:648] HybridClock initialized: now 1786085755420328 us; error 62 us; skew 500 ppm
I20260807 06:55:55.420939 21034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:55 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085755, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:55.424644 21034 init.cc:377] Logged in from keytab as oryx/127.10.191.188@KRBTEST.COM (short username oryx)
I20260807 06:55:55.426455 21034 webserver.cc:460] Webserver started at http://127.10.191.188:44487/ using document root <none> and password file <none>
I20260807 06:55:55.427273 21034 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:55.427419 21034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:55.427570 21162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.417210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.0.0.1:41386)
0807 06:55:55.421474 (+ 4264us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.421491 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.421660 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.422063 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.422070 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.422098 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:55.422336 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.422345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.423778 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.423784 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.425446 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.425485 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.426685 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.426692 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.426888 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.426974 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.427088 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.427233 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4143,"thread_start_us":3996,"threads_started":1}
I20260807 06:55:55.427570 21163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.417632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41386 (local address 127.10.191.189:38837)
0807 06:55:55.418272 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.418276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.421587 (+ 3311us) server_negotiation.cc:407] Connection header received
0807 06:55:55.421824 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.421828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.421900 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.422023 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:55.422483 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.423619 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.425641 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.426489 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.426698 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.426888 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.427115 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.427258 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":302,"threads_started":1}
I20260807 06:55:55.427825 21034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:55:55.428690 21134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f15d78b0aac40c79a4d3cf03f8b9d03. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:55.428949 21134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: LEARNER
I20260807 06:55:55.429718 21023 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: attempting to promote NON_VOTER 3ed91052c0ce4d28aede4dcc49a6ddff to VOTER
I20260807 06:55:55.430660 21023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } }
I20260807 06:55:55.431847 21034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data/instance:
uuid: "6416467a71f24cd49cd29edc8edcb6e2"
format_stamp: "Formatted at 2026-08-07 06:55:55 on dist-test-slave-tfpf"
server_key: "ff5e6ed8396f4722ef254c30396e0e19"
server_key_iv: "de661530a4100e0401ecea3c2e5827b2"
server_key_version: "encryptionkey@0"
I20260807 06:55:55.432479 21093 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 LEARNER]: Refusing update from remote peer 7f15d78b0aac40c79a4d3cf03f8b9d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 06:55:55.432793 21034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal/instance:
uuid: "6416467a71f24cd49cd29edc8edcb6e2"
format_stamp: "Formatted at 2026-08-07 06:55:55 on dist-test-slave-tfpf"
server_key: "ff5e6ed8396f4722ef254c30396e0e19"
server_key_iv: "de661530a4100e0401ecea3c2e5827b2"
server_key_version: "encryptionkey@0"
I20260807 06:55:55.433111 21025 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 06:55:55.436059 21023 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 3ed91052c0ce4d28aede4dcc49a6ddff (127.10.191.189) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } }
I20260807 06:55:55.437803 21093 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 3ed91052c0ce4d28aede4dcc49a6ddff (127.10.191.189) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } }
I20260807 06:55:55.439379 21034 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260807 06:55:55.439702 21026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } }
I20260807 06:55:55.440048 21026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:55.440438 21026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } }
I20260807 06:55:55.440646 21026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:55.441368 21134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } }
I20260807 06:55:55.441569 21134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:55:55.443533 21171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:55.445233 21034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 06:55:55.445420 21034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal
uuid: "6416467a71f24cd49cd29edc8edcb6e2"
format_stamp: "Formatted at 2026-08-07 06:55:55 on dist-test-slave-tfpf"
server_key: "ff5e6ed8396f4722ef254c30396e0e19"
server_key_iv: "de661530a4100e0401ecea3c2e5827b2"
server_key_version: "encryptionkey@0"
I20260807 06:55:55.445634 21034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:55.480149 21034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:55.484690 21034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:55.485013 21034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:55.504948 21034 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.188:36009
I20260807 06:55:55.504968 21237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.188:36009 every 8 connection(s)
I20260807 06:55:55.506418 21034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
I20260807 06:55:55.510433 21238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:55.513525 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 21034
I20260807 06:55:55.519196 21238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:55:55 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.188@KRBTEST.COM
Aug 07 06:55:55 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085755, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.188@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:55:55.537256 20989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.522149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52966 (local address 127.10.191.190:37753)
0807 06:55:55.522382 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.522391 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.523253 (+ 862us) server_negotiation.cc:407] Connection header received
0807 06:55:55.523560 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.523566 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.523644 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.523758 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.524887 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.525762 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.527196 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.527670 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.527800 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.531474 (+ 3674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.531479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.531482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.531518 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.534210 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.534995 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.535000 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.535005 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.535154 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.535559 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.535564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.535569 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.535865 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.536039 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.536598 (+ 559us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.536840 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 06:55:55.538141 21242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.516105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55736 (local address 127.10.191.188:36009)
0807 06:55:55.516990 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.517011 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.517102 (+ 91us) server_negotiation.cc:407] Connection header received
0807 06:55:55.519095 (+ 1993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.519120 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.519615 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.520034 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.521638 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.523483 (+ 1845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.524887 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.525626 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.525820 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.530330 (+ 4510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.530339 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.530351 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.530385 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.533536 (+ 3151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.534292 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.534300 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.534308 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.534477 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.534912 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.534919 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.534926 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.535503 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.535821 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.536271 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.536875 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":667,"thread_start_us":387,"threads_started":1}
I20260807 06:55:55.538194 21243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.522119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:52966)
0807 06:55:55.523111 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.523162 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.523406 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.523823 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.523830 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.524444 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:55.524723 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.524737 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.525899 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.525904 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.527046 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.527059 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.527893 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.527900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.528075 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.528735 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:55.528757 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:55.531263 (+ 2506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:55.534369 (+ 3106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.534382 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.534390 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.534861 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.535276 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.535281 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.535284 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.535439 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.536003 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:55.536014 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:55.536243 (+ 229us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.536497 (+ 254us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.537042 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":166,"thread_start_us":499,"threads_started":1}
I20260807 06:55:55.540066 21238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:55:55 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085755, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.188@KRBTEST.COM for oryx/127.10.191.189@KRBTEST.COM
I20260807 06:55:55.553303 21243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.541173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.0.0.1:41388)
0807 06:55:55.541443 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.541457 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.541583 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.541923 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.541927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.542298 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:55.542436 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.542444 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.543441 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.543446 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.544394 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.544406 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.545191 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.545197 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.545401 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.545902 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:55.545918 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:55.547782 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:55.550841 (+ 3059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.550846 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.550850 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.551246 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.551641 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.551646 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.551650 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.551790 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.552338 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:55.552343 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:55.552507 (+ 164us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.552648 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.552968 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260807 06:55:55.553431 21163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.541087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41388 (local address 127.10.191.189:38837)
0807 06:55:55.541297 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.541302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.541530 (+ 228us) server_negotiation.cc:407] Connection header received
0807 06:55:55.541718 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.541724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.541797 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.541896 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.542580 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.543266 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.544547 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.544992 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.545157 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.547979 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.547990 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.547993 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.548024 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.550707 (+ 2683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.551372 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.551377 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.551380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.551525 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.551902 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.551907 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.551910 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.552215 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.552376 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.552748 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.553005 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:55:55.554571 21238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:55:55 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085755, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.188@KRBTEST.COM for oryx/127.10.191.188@KRBTEST.COM
I20260807 06:55:55.566999 21243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.555222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:36009 (local address 127.0.0.1:55750)
0807 06:55:55.555385 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.555404 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.555504 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.555810 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.555813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.556143 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:55.556312 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.556320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.557299 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.557303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.558160 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.558180 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.558879 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.558884 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.559066 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.559621 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:55.559637 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:55.561714 (+ 2077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:55.564788 (+ 3074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.564791 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.564794 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.565227 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.565583 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.565586 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.565588 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.565739 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.566213 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:55.566217 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:55.566336 (+ 119us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.566454 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.566652 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 06:55:55.567085 21242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.555429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55750 (local address 127.10.191.188:36009)
0807 06:55:55.555568 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.555573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.555588 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:55:55.555627 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.555630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.555681 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.555765 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.556426 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.557188 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.558312 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.558731 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.558875 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.561889 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.561893 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.561896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.561924 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.564540 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.565329 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.565350 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.565352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.565485 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.565829 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.565832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.565834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.566108 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.566215 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.566535 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.566814 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":79,"server-negotiator.queue_time_us":48}
I20260807 06:55:55.572073 21238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: Bootstrap starting.
I20260807 06:55:55.575623 21238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:55.576721 21238 log.cc:824] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:55.579790 21238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: No bootstrap required, opened a new log
I20260807 06:55:55.587173 21238 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } }
I20260807 06:55:55.587555 21238 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:55.587636 21238 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6416467a71f24cd49cd29edc8edcb6e2, State: Initialized, Role: FOLLOWER
I20260807 06:55:55.588188 21238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } }
I20260807 06:55:55.589110 21246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } } }
I20260807 06:55:55.589484 21246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:55:55.590234 21238 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 06:55:55.600060 21264 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:55:55.600230 21264 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:55:55.604715 21034 master_runner.cc:428] Detected that this master 6416467a71f24cd49cd29edc8edcb6e2 is joining an existing cluster
I20260807 06:55:55.604879 21034 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.191.188:36009
I20260807 06:55:55.629618 21163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.609483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41390 (local address 127.10.191.189:38837)
0807 06:55:55.609703 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.609711 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.611042 (+ 1331us) server_negotiation.cc:407] Connection header received
0807 06:55:55.611357 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.611362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.611451 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.611542 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.614354 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.615396 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.617771 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.618473 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.618632 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.622291 (+ 3659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.622297 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.622304 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.622355 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.626121 (+ 3766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.627034 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.627041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.627047 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.627209 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.627747 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.627753 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.627756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.628145 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.628291 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.628970 (+ 679us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.629273 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:55:55.630594 20989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.609884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52970 (local address 127.10.191.190:37753)
0807 06:55:55.610073 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.610079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.611621 (+ 1542us) server_negotiation.cc:407] Connection header received
0807 06:55:55.611888 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.611893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.611992 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.612077 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.613984 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.615264 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.617914 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.618612 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.618762 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.622365 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.622371 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.622394 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.622439 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.626770 (+ 4331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.627722 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.627729 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.627733 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.627907 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.628481 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.628486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.628490 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.628880 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.629051 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.629982 (+ 931us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.630237 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:55:55.630695 21275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.609532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.0.0.1:41390)
0807 06:55:55.610872 (+ 1340us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.610904 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.611174 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.611864 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.611871 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.613025 (+ 1154us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:55.614181 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.614194 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.615612 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.615617 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.617569 (+ 1952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.617584 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.619104 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.619113 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.619514 (+ 401us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.620542 (+ 1028us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:55.620566 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:55.621988 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:55.626288 (+ 4300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.626293 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.626297 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.626844 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.627358 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.627362 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.627366 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.627611 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.628375 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:55.628380 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:55.628649 (+ 269us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.629906 (+ 1257us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.630265 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1091,"mutex_wait_us":250,"thread_start_us":879,"threads_started":1}
I20260807 06:55:55.631632 21242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.611343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55766 (local address 127.10.191.188:36009)
0807 06:55:55.611527 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.611532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.613960 (+ 2428us) server_negotiation.cc:407] Connection header received
0807 06:55:55.614209 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.614214 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.614276 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.614335 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.615701 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.617048 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.619049 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.619843 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.619922 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.623518 (+ 3596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.623534 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.623541 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.623584 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.627924 (+ 4340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.628743 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.628760 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.628764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.628919 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.629338 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.629342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.629345 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.629715 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.630053 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.630548 (+ 495us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.631262 (+ 714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":60}
I20260807 06:55:55.631989 21277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.610033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:52970)
0807 06:55:55.611204 (+ 1171us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.611221 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.611721 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.612317 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.612321 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.613260 (+ 939us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:55.613791 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.613808 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.615495 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.615530 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.617738 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.617751 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.619081 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.619087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.619399 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.620345 (+ 946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:55.620366 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:55.622106 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:55.626953 (+ 4847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.626962 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.626966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.627564 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.628046 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.628051 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.628055 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.628335 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.629122 (+ 787us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:55.629125 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:55.629521 (+ 396us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.629660 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.631409 (+ 1749us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1030,"mutex_wait_us":482,"spinlock_wait_cycles":7936,"thread_start_us":828,"threads_started":1}
I20260807 06:55:55.632737 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.611368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:36009 (local address 127.0.0.1:55766)
0807 06:55:55.613838 (+ 2470us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.613857 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.614054 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.614516 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.614520 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.615136 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:55.615533 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.615546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.617323 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.617328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.618896 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.618920 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.620292 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.620301 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.620501 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.621250 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:55.621294 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:55.622841 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:55.628049 (+ 5208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.628053 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.628056 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.628613 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.629070 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.629074 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.629078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.629233 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.630140 (+ 907us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:55.630146 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:55.630299 (+ 153us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.631924 (+ 1625us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.632329 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2357,"spinlock_wait_cycles":75776,"thread_start_us":2169,"threads_started":1}
Aug 07 06:55:55 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085752, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.190@KRBTEST.COM for oryx/127.10.191.188@KRBTEST.COM
I20260807 06:55:55.646092 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 20337
I20260807 06:55:55.651934 21162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.637574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:36009 (local address 127.0.0.1:55772)
0807 06:55:55.637801 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.637827 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.637965 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.638326 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.638331 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.638825 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:55.639014 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.639026 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.640102 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.640107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.640971 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.640983 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.641968 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.641972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.642077 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.642616 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:55.642632 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:55.645139 (+ 2507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:55.649533 (+ 4394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.649538 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.649541 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.649990 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.650361 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.650365 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.650368 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.650540 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.651010 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:55.651014 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:55.651179 (+ 165us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.651308 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.651598 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 06:55:55.651937 21242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.637653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55772 (local address 127.10.191.188:36009)
0807 06:55:55.637816 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.637823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.637900 (+ 77us) server_negotiation.cc:407] Connection header received
0807 06:55:55.638109 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.638112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.638190 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.638262 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.639166 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.639888 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.641141 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.641836 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.641970 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.645318 (+ 3348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.645324 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.645329 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.645365 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.649405 (+ 4040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.650097 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.650103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.650108 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.650253 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.650640 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.650644 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.650647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.650895 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.651040 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.651418 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.651622 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:55:55.653401 20255 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.191.188:36009: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2"
member_type: NON_VOTER
last_known_addr {
host: "127.10.191.188"
port: 36009
}
attrs {
promote: true
}
}
dest_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03"
cas_config_opid_index: 6
I20260807 06:55:55.654263 20255 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } }
I20260807 06:55:55.656605 21093 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Refusing update from remote peer 7f15d78b0aac40c79a4d3cf03f8b9d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 06:55:55.656957 21207 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 06:55:55 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.129@KRBTEST.COM
I20260807 06:55:55.660353 21207 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 FOLLOWER]: Refusing update from remote peer 7f15d78b0aac40c79a4d3cf03f8b9d03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 06:55:55.660959 21023 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 06:55:55.661692 21023 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:55.663995 21025 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 6416467a71f24cd49cd29edc8edcb6e2 (127.10.191.188) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } } }
I20260807 06:55:55.665241 21093 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 6416467a71f24cd49cd29edc8edcb6e2 (127.10.191.188) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } } }
I20260807 06:55:55.668398 21025 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.191.188:36009
I20260807 06:55:55.669263 21034 master.cc:537] Master@127.10.191.188:36009 shutting down...
I20260807 06:55:55.670276 21025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } } }
I20260807 06:55:55.670352 21026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } } }
I20260807 06:55:55.670584 21025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:55.670634 21279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.647242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58798 (local address 127.10.191.129:33051)
0807 06:55:55.647967 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.647978 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.648009 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:55:55.648081 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.648091 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.648388 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.648564 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.650247 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.651734 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.653719 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.654710 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.654830 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.660704 (+ 5874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.660725 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.660745 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.660800 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.665342 (+ 4542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.666748 (+ 1406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.666759 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.666763 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.666945 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.667526 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.667543 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.667546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.668024 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.669682 (+ 1658us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.669853 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.670179 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":362,"threads_started":1}
I20260807 06:55:55.670644 21026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:55.671566 21134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } } }
I20260807 06:55:55.671867 21134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:55:55.672159 20497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:55.686127 21207 raft_consensus.cc:858] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } }
W20260807 06:55:55.686355 21207 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } }
I20260807 06:55:55.723979 21207 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3ed91052c0ce4d28aede4dcc49a6ddff (127.10.191.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:55.731871 21287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:55.732517 21246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f15d78b0aac40c79a4d3cf03f8b9d03. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:55.732812 21283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: NON_VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: true } } }
I20260807 06:55:55.733227 21283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260807 06:55:55.732837 21246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260807 06:55:55.732519 21287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260807 06:55:55.734814 21025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } } }
I20260807 06:55:55.735122 21025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
W20260807 06:55:55.736399 20238 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260807 06:55:55.737636 21034 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260807 06:55:55.738202 21034 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260807 06:55:55.738389 21034 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: stopping tablet replica
W20260807 06:55:55.738782 20238 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 -> Peer 6416467a71f24cd49cd29edc8edcb6e2 (127.10.191.188:36009): Couldn't send request to peer 6416467a71f24cd49cd29edc8edcb6e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 06:55:55.746604 21034 master.cc:552] Master@127.10.191.188:36009 shutdown complete.
I20260807 06:55:55.746701 21034 master_runner.cc:305] Clearing existing system tablet
I20260807 06:55:55.747131 21034 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:55.747246 21034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:55.753791 21034 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.004s
I20260807 06:55:55.757449 21291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:55.757917 21034 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:55.758168 21034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 06:55:55.758256 21034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal
uuid: "6416467a71f24cd49cd29edc8edcb6e2"
format_stamp: "Formatted at 2026-08-07 06:55:55 on dist-test-slave-tfpf"
server_key: "ff5e6ed8396f4722ef254c30396e0e19"
server_key_iv: "de661530a4100e0401ecea3c2e5827b2"
server_key_version: "encryptionkey@0"
I20260807 06:55:55.762544 21034 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:55.769390 21034 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 06:55:55.769577 21034 log.cc:1196] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 06:55:55.770108 21034 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: Deleting consensus metadata
I20260807 06:55:55.770359 21034 master_runner.cc:315] Copying system tablet from 127.10.191.190:37753
I20260807 06:55:55.778713 21034 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.191.190:37753
I20260807 06:55:55.804911 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 20337
I20260807 06:55:55.807018 20989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.780125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52980 (local address 127.10.191.190:37753)
0807 06:55:55.780331 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:55.780337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:55.791930 (+ 11593us) server_negotiation.cc:407] Connection header received
0807 06:55:55.792255 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:55.792262 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:55.792359 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:55.792448 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:55.793922 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.795001 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.796956 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.797579 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.797677 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.800157 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:55.800163 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:55.800167 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:55.800207 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:55.803621 (+ 3414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.804422 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.804428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.804431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.804609 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:55.805021 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:55.805027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:55.805032 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:55.805379 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:55.805519 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:55.806218 (+ 699us) server_negotiation.cc:299] Negotiation successful
0807 06:55:55.806515 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 06:55:55.808040 21299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:55.780078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:52980)
0807 06:55:55.791772 (+ 11694us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:55.791797 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:55.792092 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:55.792767 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:55.792771 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:55.793393 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:55.793731 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.793745 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.795189 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.795194 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.796755 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:55.796775 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:55.797937 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:55.797942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:55.798108 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:55.798858 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:55.798885 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:55.799938 (+ 1053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:55.803798 (+ 3860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.803803 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.803807 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.804286 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.804743 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:55.804747 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:55.804750 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:55.804914 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:55.805592 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:55.805599 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:55.805842 (+ 243us) client_negotiation.cc:769] Sending connection context
0807 06:55:55.807239 (+ 1397us) client_negotiation.cc:240] Negotiation successful
0807 06:55:55.807582 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11534,"thread_start_us":11375,"threads_started":1}
I20260807 06:55:55.809335 20282 tablet_copy_service.cc:140] P 7f15d78b0aac40c79a4d3cf03f8b9d03: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 6416467a71f24cd49cd29edc8edcb6e2 ({username='oryx', principal='oryx/127.10.191.188@KRBTEST.COM'} at 127.0.0.1:52980)
I20260807 06:55:55.809507 20282 tablet_copy_service.cc:161] P 7f15d78b0aac40c79a4d3cf03f8b9d03: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 6416467a71f24cd49cd29edc8edcb6e2 at {username='oryx', principal='oryx/127.10.191.188@KRBTEST.COM'} at 127.0.0.1:52980: session id = 6416467a71f24cd49cd29edc8edcb6e2-00000000000000000000000000000000
I20260807 06:55:55.811813 20282 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 06:55:55.814014 21034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 06:55:55.821966 21034 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: tablet copy: Starting download of 0 data blocks...
I20260807 06:55:55.822284 21034 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: tablet copy: Starting download of 1 WAL segments...
I20260807 06:55:55.825138 21034 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 06:55:55.830363 20282 tablet_copy_service.cc:342] P 7f15d78b0aac40c79a4d3cf03f8b9d03: Request end of tablet copy session 6416467a71f24cd49cd29edc8edcb6e2-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.191.188@KRBTEST.COM'} at 127.0.0.1:52980
I20260807 06:55:55.830570 20282 tablet_copy_service.cc:433] P 7f15d78b0aac40c79a4d3cf03f8b9d03: ending tablet copy session 6416467a71f24cd49cd29edc8edcb6e2-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 6416467a71f24cd49cd29edc8edcb6e2
I20260807 06:55:55.840764 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:33051
--local_ip_for_outbound_sockets=127.10.191.129
--tserver_master_addrs=127.10.191.190:37753
--webserver_port=38655
--webserver_interface=127.10.191.129
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab
--principal=oryx/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.191.190:37753,127.10.191.189:38837
--tserver_master_addrs=127.10.191.190:37753,127.10.191.189:38837,127.10.191.188:36009 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:55:55.845155 21034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:55.852432 21304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:55.852540 21302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:55.866007 21307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:55.866225 21034 server_base.cc:1034] running on GCE node
I20260807 06:55:55.866739 21034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:55.867450 21034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:55.868662 21034 hybrid_clock.cc:648] HybridClock initialized: now 1786085755868612 us; error 39 us; skew 500 ppm
I20260807 06:55:55.868943 21034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:55 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085755, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:55.871276 21034 init.cc:377] Logged in from keytab as oryx/127.10.191.188@KRBTEST.COM (short username oryx)
I20260807 06:55:55.874215 21034 webserver.cc:460] Webserver started at http://127.10.191.188:46047/ using document root <none> and password file <none>
I20260807 06:55:55.874614 21034 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:55.874722 21034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:55.877942 21034 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 06:55:55.880087 21320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:55.880578 21034 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260807 06:55:55.880764 21034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal
uuid: "6416467a71f24cd49cd29edc8edcb6e2"
format_stamp: "Formatted at 2026-08-07 06:55:55 on dist-test-slave-tfpf"
server_key: "ff5e6ed8396f4722ef254c30396e0e19"
server_key_iv: "de661530a4100e0401ecea3c2e5827b2"
server_key_version: "encryptionkey@0"
I20260807 06:55:55.881047 21034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:55.897954 21034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:55.902005 21034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:55.931571 21034 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.188:36009
I20260807 06:55:55.931645 21398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.188:36009 every 8 connection(s)
I20260807 06:55:55.932796 21034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
I20260807 06:55:55.938308 21399 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:55:55.942386 21399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: Bootstrap starting.
I20260807 06:55:55.958305 21399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:55:55.958905 21399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: Bootstrap complete.
I20260807 06:55:55.960037 21399 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } }
I20260807 06:55:55.960381 21399 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6416467a71f24cd49cd29edc8edcb6e2, State: Initialized, Role: LEARNER
I20260807 06:55:55.960685 21399 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } }
I20260807 06:55:55.961627 21405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } } }
I20260807 06:55:55.961938 21399 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:55:55.962102 21405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:55:55.972848 21417 catalog_manager.cc:1259] Loaded cluster ID: 4c9482d971a9446eaae1b8bde6eaceb5
I20260807 06:55:55.972975 21417 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: loading cluster ID for follower catalog manager: success
I20260807 06:55:55.976585 21417 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: acquiring CA information for follower catalog manager: success
I20260807 06:55:55.979068 21417 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 06:55:56.229777 21305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:56.230120 21305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:56.230285 21305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:56.237673 21305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:56.237840 21305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:56.238019 21305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:55:56.248286 21305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab
--principal=oryx/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:33051
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=38655
--tserver_master_addrs=127.10.191.190:37753,127.10.191.189:38837,127.10.191.188:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:56.249852 21305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:56.251194 21305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:56.265012 21425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:56.265038 21426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:56.265074 21429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:56.266741 21305 server_base.cc:1034] running on GCE node
I20260807 06:55:56.267472 21305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:56.268555 21305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:56.269800 21305 hybrid_clock.cc:648] HybridClock initialized: now 1786085756269724 us; error 65 us; skew 500 ppm
I20260807 06:55:56.270166 21305 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:56 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085756, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:56.273586 21305 init.cc:377] Logged in from keytab as oryx/127.10.191.129@KRBTEST.COM (short username oryx)
I20260807 06:55:56.275121 21305 webserver.cc:460] Webserver started at http://127.10.191.129:38655/ using document root <none> and password file <none>
I20260807 06:55:56.275832 21305 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:56.275992 21305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:56.281708 21305 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:55:56.284796 21438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:56.286466 21305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:55:56.286602 21023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } } }
I20260807 06:55:56.286934 21023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:56.286691 21305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "c8646bd931bb404abe5167e704296b3e"
format_stamp: "Formatted at 2026-08-07 06:55:53 on dist-test-slave-tfpf"
server_key: "6e373945e7889cfdf8c4e7b4ef175fe8"
server_key_iv: "1a77a94e7acdfadece0d52659bafe415"
server_key_version: "encryptionkey@0"
I20260807 06:55:56.288378 21305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:56.302686 21446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:56.287147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55774 (local address 127.10.191.188:36009)
0807 06:55:56.296909 (+ 9762us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:56.296918 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:56.297468 (+ 550us) server_negotiation.cc:407] Connection header received
0807 06:55:56.297706 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:56.297714 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:56.297819 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:56.297979 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:56.298395 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.299354 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.300813 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.301630 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.301849 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:56.302027 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:56.302223 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 06:55:56.302355 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9505,"thread_start_us":9428,"threads_started":1}
I20260807 06:55:56.302721 21443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:56.286943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:36009 (local address 127.0.0.1:55774)
0807 06:55:56.297236 (+ 10293us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:56.297266 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:56.297513 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:56.298019 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:56.298024 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:56.298055 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:56.298252 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:56.298262 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.299512 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.299518 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:56.300642 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:56.300653 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.301840 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.301845 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:56.302016 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:56.302070 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 06:55:56.302195 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 06:55:56.302348 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10081,"thread_start_us":9938,"threads_started":1}
I20260807 06:55:56.303613 21362 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.5->[1.6-1.7] Dedup: 1.7->[]
I20260807 06:55:56.304072 21405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f15d78b0aac40c79a4d3cf03f8b9d03. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: NON_VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: true } } }
I20260807 06:55:56.304348 21405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: This master's current role is: LEARNER
I20260807 06:55:56.304725 21023 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: attempting to promote NON_VOTER 6416467a71f24cd49cd29edc8edcb6e2 to VOTER
I20260807 06:55:56.305533 21023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } }
I20260807 06:55:56.307447 21093 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Refusing update from remote peer 7f15d78b0aac40c79a4d3cf03f8b9d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 06:55:56.307448 21362 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 LEARNER]: Refusing update from remote peer 7f15d78b0aac40c79a4d3cf03f8b9d03: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 06:55:56.308012 21023 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 06:55:56.308290 21442 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 06:55:56.310894 21442 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6416467a71f24cd49cd29edc8edcb6e2 (127.10.191.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:56.312155 21362 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6416467a71f24cd49cd29edc8edcb6e2 (127.10.191.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:56.314035 21093 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6416467a71f24cd49cd29edc8edcb6e2 (127.10.191.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:56.314327 21440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:56.314851 21440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:56.315193 21440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:56.315471 21440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:56.315771 21023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:56.316079 21023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03 [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:56.317452 21305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:56.321718 21405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:56.322048 21405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:55:56.324326 21305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:56.324649 21305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:56.325542 21457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:56.326035 21305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:56.326109 21457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:55:56.327672 21305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:56.327824 21305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:56.327916 21305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:56.327973 21305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:56.359901 21305 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:33051
I20260807 06:55:56.359987 21610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:33051 every 8 connection(s)
I20260807 06:55:56.361447 21305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:55:56.368789 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 21305
I20260807 06:55:56.369310 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 20511
Aug 07 06:55:56 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085756, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.189@KRBTEST.COM
Aug 07 06:55:56 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085756, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
Aug 07 06:55:56 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085756, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.188@KRBTEST.COM
Aug 07 06:55:56 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.130@KRBTEST.COM
I20260807 06:55:56.405442 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:56.364409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:58031 (local address 127.10.191.190:37753)
0807 06:55:56.377108 (+ 12699us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:56.377118 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:56.378454 (+ 1336us) server_negotiation.cc:407] Connection header received
0807 06:55:56.382828 (+ 4374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:56.382836 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:56.382942 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:56.383054 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:56.386747 (+ 3693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.387929 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.391300 (+ 3371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.391987 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.392096 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:56.397509 (+ 5413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:56.397517 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:56.397521 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:56.397568 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:56.401137 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:56.402121 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:56.402128 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:56.402132 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:56.402296 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:56.402813 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:56.402819 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:56.403043 (+ 224us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:56.403482 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:56.403668 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:56.404726 (+ 1058us) server_negotiation.cc:299] Negotiation successful
0807 06:55:56.404993 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12408,"thread_start_us":12740,"threads_started":1}
I20260807 06:55:56.406245 21618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:56.365627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:34141 (local address 127.10.191.189:38837)
0807 06:55:56.366250 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:56.366259 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:56.382928 (+ 16669us) server_negotiation.cc:407] Connection header received
0807 06:55:56.383020 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:56.383027 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:56.383157 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:56.383278 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:56.386802 (+ 3524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.387903 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.390494 (+ 2591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.391126 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.391222 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:56.397526 (+ 6304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:56.397534 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:56.397541 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:56.397592 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:56.400696 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:56.403167 (+ 2471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:56.403174 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:56.403177 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:56.403322 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:56.403844 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:56.403851 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:56.403856 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:56.404263 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:56.404400 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:56.405334 (+ 934us) server_negotiation.cc:299] Negotiation successful
0807 06:55:56.405869 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":251,"threads_started":1}
I20260807 06:55:56.407024 21446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:56.379596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:42643 (local address 127.10.191.188:36009)
0807 06:55:56.379853 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:56.379861 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:56.387625 (+ 7764us) server_negotiation.cc:407] Connection header received
0807 06:55:56.387721 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:56.387726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:56.387797 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:56.387885 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:56.389264 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.390213 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.391976 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.393157 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.393275 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:56.400473 (+ 7198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:56.400480 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:56.400485 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:56.400531 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:56.404018 (+ 3487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:56.404865 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:56.404870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:56.404873 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:56.405032 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:56.405479 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:56.405485 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:56.405490 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:56.405826 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:56.405942 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:56.406465 (+ 523us) server_negotiation.cc:299] Negotiation successful
0807 06:55:56.406704 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 06:55:56.407819 21623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:56.365604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.10.191.129:34141)
0807 06:55:56.382357 (+ 16753us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:56.382380 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:56.382549 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:56.383814 (+ 1265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:56.383832 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:56.385254 (+ 1422us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:56.386527 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:56.386545 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.388062 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.388067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:56.390331 (+ 2264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:56.390344 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.391589 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.391597 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:56.391912 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:56.392707 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:56.392738 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:56.397207 (+ 4469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:56.401186 (+ 3979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:56.401198 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:56.401220 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:56.403008 (+ 1788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:56.403502 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:56.403507 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:56.403512 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:56.403696 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:56.404482 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:56.404487 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:56.404684 (+ 197us) client_negotiation.cc:769] Sending connection context
0807 06:55:56.406688 (+ 2004us) client_negotiation.cc:240] Negotiation successful
0807 06:55:56.406983 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16583,"mutex_wait_us":136,"spinlock_wait_cycles":16000,"thread_start_us":21622,"threads_started":1}
I20260807 06:55:56.407852 21616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:56.365054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.129:58031)
0807 06:55:56.378185 (+ 13131us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:56.378267 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:56.382377 (+ 4110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:56.383814 (+ 1437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:56.383831 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:56.385255 (+ 1424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:56.386515 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:56.386539 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.389713 (+ 3174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.389717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:56.391133 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:56.391147 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.392366 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.392371 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:56.392530 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:56.393093 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:56.393113 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:56.397196 (+ 4083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:56.401302 (+ 4106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:56.401307 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:56.401310 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:56.401959 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:56.402397 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:56.402401 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:56.402405 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:56.402664 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:56.403640 (+ 976us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:56.403649 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:56.404172 (+ 523us) client_negotiation.cc:769] Sending connection context
0807 06:55:56.405688 (+ 1516us) client_negotiation.cc:240] Negotiation successful
0807 06:55:56.406257 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12591,"mutex_wait_us":144,"spinlock_wait_cycles":11008,"thread_start_us":12350,"threads_started":1}
I20260807 06:55:56.407941 21619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:56.381619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:36009 (local address 127.10.191.129:42643)
0807 06:55:56.387502 (+ 5883us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:56.387519 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:56.387630 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:56.388062 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:56.388065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:56.388724 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:56.389046 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:56.389099 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.390382 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.390389 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:56.391825 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:56.391837 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.393582 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.393624 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:56.393834 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:56.394465 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:56.394492 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:56.400214 (+ 5722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:56.404177 (+ 3963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:56.404182 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:56.404185 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:56.404719 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:56.405199 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:56.405203 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:56.405206 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:56.405357 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:56.406038 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:56.406042 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:56.406173 (+ 131us) client_negotiation.cc:769] Sending connection context
0807 06:55:56.407271 (+ 1098us) client_negotiation.cc:240] Negotiation successful
0807 06:55:56.407547 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5763,"mutex_wait_us":22,"thread_start_us":526,"threads_started":1}
I20260807 06:55:56.409686 21613 heartbeater.cc:347] Connected to a master server at 127.10.191.189:38837
I20260807 06:55:56.410068 21613 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:56.410533 21611 heartbeater.cc:347] Connected to a master server at 127.10.191.188:36009
I20260807 06:55:56.410683 21611 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:56.411162 21611 heartbeater.cc:511] Master 127.10.191.188:36009 requested a full tablet report, sending...
I20260807 06:55:56.411196 21612 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37753
I20260807 06:55:56.411232 21613 heartbeater.cc:511] Master 127.10.191.189:38837 requested a full tablet report, sending...
I20260807 06:55:56.411372 21612 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:56.411486 21622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:56.370603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47156 (local address 127.10.191.130:45945)
0807 06:55:56.386392 (+ 15789us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:56.386401 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:56.386431 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:55:56.386512 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:56.386521 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:56.386776 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:56.386932 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:56.389675 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.391107 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.392966 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:56.394049 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:56.394812 (+ 763us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:56.402049 (+ 7237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:56.402069 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:56.402089 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:56.402139 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:56.406601 (+ 4462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:56.407549 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:56.407557 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:56.407560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:56.407721 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:56.408170 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:56.408175 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:56.408177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:56.408631 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:56.408892 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:56.410428 (+ 1536us) server_negotiation.cc:299] Negotiation successful
0807 06:55:56.411048 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15609,"thread_start_us":17072,"threads_started":1}
I20260807 06:55:56.411888 21612 heartbeater.cc:511] Master 127.10.191.190:37753 requested a full tablet report, sending...
I20260807 06:55:56.412922 20694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:56.413440 20255 ts_manager.cc:194] Re-registered known tserver with Master: c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051)
I20260807 06:55:56.414203 21347 ts_manager.cc:194] Registered new tserver with Master: c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051)
I20260807 06:55:56.414202 21079 ts_manager.cc:194] Registered new tserver with Master: c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051)
I20260807 06:55:56.414371 20255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:58031
I20260807 06:55:56.499423 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 20511
I20260807 06:55:56.524484 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:45945
--local_ip_for_outbound_sockets=127.10.191.130
--tserver_master_addrs=127.10.191.190:37753
--webserver_port=37945
--webserver_interface=127.10.191.130
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab
--principal=oryx/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.191.190:37753,127.10.191.189:38837
--tserver_master_addrs=127.10.191.190:37753,127.10.191.189:38837,127.10.191.188:36009 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:55:56.891422 21625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:56.891796 21625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:56.891958 21625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:56.899468 21625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:56.899667 21625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:56.899847 21625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:55:56.911119 21625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab
--principal=oryx/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:45945
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=37945
--tserver_master_addrs=127.10.191.190:37753,127.10.191.189:38837,127.10.191.188:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:56.912621 21625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:56.914121 21625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:56.928402 21632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:56.928463 21631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:56.929039 21636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:56.930392 21625 server_base.cc:1034] running on GCE node
I20260807 06:55:56.931094 21625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:56.932233 21625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:56.933452 21625 hybrid_clock.cc:648] HybridClock initialized: now 1786085756933401 us; error 43 us; skew 500 ppm
I20260807 06:55:56.933830 21625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:56 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085756, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:56.937282 21625 init.cc:377] Logged in from keytab as oryx/127.10.191.130@KRBTEST.COM (short username oryx)
I20260807 06:55:56.939152 21625 webserver.cc:460] Webserver started at http://127.10.191.130:37945/ using document root <none> and password file <none>
I20260807 06:55:56.940126 21625 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:56.940284 21625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:56.946120 21625 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 06:55:56.948726 21647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:56.950122 21625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:55:56.950294 21625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "dee1f504ab3b4a02a1e465ea780a3b9c"
format_stamp: "Formatted at 2026-08-07 06:55:53 on dist-test-slave-tfpf"
server_key: "b27365a163ca4afef7b92a36b7069ae6"
server_key_iv: "5e2463ae3abf8c59534397cdb552ee2a"
server_key_version: "encryptionkey@0"
I20260807 06:55:56.951241 21625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:56.972657 21625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:56.977173 21625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:56.977433 21625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:56.978413 21625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:56.979913 21625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:56.980006 21625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:56.980089 21625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:56.980140 21625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:57.013919 21625 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:45945
I20260807 06:55:57.014024 21788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:45945 every 8 connection(s)
I20260807 06:55:57.015506 21625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:55:57.024166 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 21625
I20260807 06:55:57.024507 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 20708
Aug 07 06:55:57 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085756, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.189@KRBTEST.COM
Aug 07 06:55:57 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085756, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.188@KRBTEST.COM
Aug 07 06:55:57 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085756, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
Aug 07 06:55:57 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.131@KRBTEST.COM
I20260807 06:55:57.044582 21797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.019062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:47485 (local address 127.10.191.189:38837)
0807 06:55:57.019877 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.019885 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.020824 (+ 939us) server_negotiation.cc:407] Connection header received
0807 06:55:57.023551 (+ 2727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.023557 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.023645 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.023762 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.027250 (+ 3488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.028165 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.030408 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.030956 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.031059 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.036439 (+ 5380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.036446 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.036450 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.036492 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.040581 (+ 4089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.041666 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.041673 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.041678 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.041816 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.042333 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.042338 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.042342 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.042733 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.042871 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.043939 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.044195 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":565,"threads_started":1}
I20260807 06:55:57.045991 21800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.019451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.130:52333)
0807 06:55:57.020613 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.020671 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.023160 (+ 2489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.024496 (+ 1336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.024503 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.025499 (+ 996us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:57.027356 (+ 1857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.027368 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.029979 (+ 2611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.029983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.031270 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.031294 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.032535 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.032548 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.032761 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.033403 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:57.033422 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:57.037157 (+ 3735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:57.042213 (+ 5056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.042222 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.042226 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.042680 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.043261 (+ 581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.043265 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.043268 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.043417 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.044843 (+ 1426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:57.044848 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:57.045096 (+ 248us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.045233 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.045506 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":986,"mutex_wait_us":239,"spinlock_wait_cycles":135680,"thread_start_us":560,"threads_started":1}
I20260807 06:55:57.046090 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.019451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.10.191.130:47485)
0807 06:55:57.020613 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.020675 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.023161 (+ 2486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.024189 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.024197 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.025499 (+ 1302us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:57.027103 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.027113 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.028348 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.028357 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.030040 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.030052 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.031388 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.031396 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.031623 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.032442 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:57.032484 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:57.036159 (+ 3675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:57.040788 (+ 4629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.040800 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.040823 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.041504 (+ 681us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.041935 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.041938 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.041939 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.042193 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.042968 (+ 775us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:57.042979 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:57.043458 (+ 479us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.043830 (+ 372us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.044393 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":823,"mutex_wait_us":735,"spinlock_wait_cycles":40832,"thread_start_us":495,"threads_started":1}
I20260807 06:55:57.046015 21801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.021332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:36009 (local address 127.10.191.130:53131)
0807 06:55:57.021949 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.021970 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.023160 (+ 1190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.024192 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.024200 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.025500 (+ 1300us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:57.026705 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.026732 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.027923 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.027929 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.030242 (+ 2313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.030253 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.031179 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.031204 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.031625 (+ 421us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.032438 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:57.032468 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:57.036231 (+ 3763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:57.041698 (+ 5467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.041703 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.041706 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.042279 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.042701 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.042708 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.042713 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.042833 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.044579 (+ 1746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:57.044584 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:57.044774 (+ 190us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.044914 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.045264 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":370,"spinlock_wait_cycles":5760,"thread_start_us":307,"threads_started":1}
I20260807 06:55:57.047165 21796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.018736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:52333 (local address 127.10.191.190:37753)
0807 06:55:57.019249 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.019259 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.021125 (+ 1866us) server_negotiation.cc:407] Connection header received
0807 06:55:57.023536 (+ 2411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.023543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.023691 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.023806 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.027526 (+ 3720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.028515 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.031462 (+ 2947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.032074 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.032199 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.037384 (+ 5185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.037390 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.037395 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.037442 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.041424 (+ 3982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.042933 (+ 1509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.042937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.042939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.043116 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.043563 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.043568 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.043571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.043983 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.044142 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.046062 (+ 1920us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.046784 (+ 722us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":507,"threads_started":1}
I20260807 06:55:57.047696 21792 heartbeater.cc:347] Connected to a master server at 127.10.191.189:38837
I20260807 06:55:57.048038 21792 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:57.048041 21791 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37753
I20260807 06:55:57.048211 21791 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:57.048487 21802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.021581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:53131 (local address 127.10.191.188:36009)
0807 06:55:57.022484 (+ 903us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.022491 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.022510 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:55:57.023588 (+ 1078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.023593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.023692 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.023785 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.026906 (+ 3121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.027765 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.030370 (+ 2605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.030927 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.031984 (+ 1057us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.036441 (+ 4457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.036446 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.036450 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.036492 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.041561 (+ 5069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.042424 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.042429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.042432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.042577 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.043293 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.043300 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.043305 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.044420 (+ 1115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.047525 (+ 3105us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.047656 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.047943 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":772,"thread_start_us":608,"threads_started":1}
I20260807 06:55:57.049261 21791 heartbeater.cc:511] Master 127.10.191.190:37753 requested a full tablet report, sending...
I20260807 06:55:57.049289 21792 heartbeater.cc:511] Master 127.10.191.189:38837 requested a full tablet report, sending...
I20260807 06:55:57.049541 21789 heartbeater.cc:347] Connected to a master server at 127.10.191.188:36009
I20260807 06:55:57.049675 21789 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:57.050200 21789 heartbeater.cc:511] Master 127.10.191.188:36009 requested a full tablet report, sending...
I20260807 06:55:57.051266 20255 ts_manager.cc:194] Re-registered known tserver with Master: dee1f504ab3b4a02a1e465ea780a3b9c (127.10.191.130:45945)
I20260807 06:55:57.051399 21347 ts_manager.cc:194] Registered new tserver with Master: dee1f504ab3b4a02a1e465ea780a3b9c (127.10.191.130:45945)
I20260807 06:55:57.051419 21079 ts_manager.cc:194] Registered new tserver with Master: dee1f504ab3b4a02a1e465ea780a3b9c (127.10.191.130:45945)
I20260807 06:55:57.052434 20255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:52333
I20260807 06:55:57.052613 21803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.025599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36542 (local address 127.10.191.131:44405)
0807 06:55:57.026611 (+ 1012us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.026618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.027926 (+ 1308us) server_negotiation.cc:407] Connection header received
0807 06:55:57.028035 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.028045 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.028327 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.029216 (+ 889us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.030346 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.032724 (+ 2378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.034716 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.035341 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.035461 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.042294 (+ 6833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.042314 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.042333 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.042390 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.047564 (+ 5174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.049042 (+ 1478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.049053 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.049083 (+ 30us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.049271 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.049820 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.049825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.049828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.050309 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.050633 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.051918 (+ 1285us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.052231 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":842,"thread_start_us":714,"threads_started":1}
I20260807 06:55:57.054147 20879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:57.134598 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 20708
I20260807 06:55:57.166145 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:44405
--local_ip_for_outbound_sockets=127.10.191.131
--tserver_master_addrs=127.10.191.190:37753
--webserver_port=34673
--webserver_interface=127.10.191.131
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab
--principal=oryx/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.191.190:37753,127.10.191.189:38837
--tserver_master_addrs=127.10.191.190:37753,127.10.191.189:38837,127.10.191.188:36009 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:55:57.417868 21612 heartbeater.cc:503] Master 127.10.191.190:37753 was elected leader, sending a full tablet report...
W20260807 06:55:57.526934 21806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:55:57.527230 21806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:55:57.527323 21806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:55:57.534538 21806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:55:57.534673 21806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:55:57.534801 21806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:55:57.544965 21806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab
--principal=oryx/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:44405
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=34673
--tserver_master_addrs=127.10.191.190:37753,127.10.191.189:38837,127.10.191.188:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:55:57.546792 21806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:55:57.548410 21806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:55:57.562193 21813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:57.562213 21814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:55:57.562269 21816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:55:57.563045 21806 server_base.cc:1034] running on GCE node
I20260807 06:55:57.563954 21806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:55:57.565153 21806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:55:57.566386 21806 hybrid_clock.cc:648] HybridClock initialized: now 1786085757566337 us; error 39 us; skew 500 ppm
I20260807 06:55:57.566689 21806 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:55:57 dist-test-slave-tfpf krb5kdc[20196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085757, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:55:57.569859 21806 init.cc:377] Logged in from keytab as oryx/127.10.191.131@KRBTEST.COM (short username oryx)
I20260807 06:55:57.571308 21806 webserver.cc:460] Webserver started at http://127.10.191.131:34673/ using document root <none> and password file <none>
I20260807 06:55:57.572048 21806 fs_manager.cc:359] Metadata directory not provided
I20260807 06:55:57.572224 21806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:55:57.578061 21806 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260807 06:55:57.580924 21823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:57.582463 21806 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:55:57.582656 21806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "6d7f9c5340984028adb8636ff0e3faec"
format_stamp: "Formatted at 2026-08-07 06:55:54 on dist-test-slave-tfpf"
server_key: "ff1daaf723611f9bb027de5421f949b5"
server_key_iv: "03cd4ca319810f93e96641ec44fa4e93"
server_key_version: "encryptionkey@0"
I20260807 06:55:57.583740 21806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:55:57.597183 21806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:55:57.601051 21806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:55:57.601390 21806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:55:57.602386 21806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:55:57.603865 21806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:55:57.603996 21806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:57.604141 21806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:55:57.604247 21806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:55:57.638042 21806 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:44405
I20260807 06:55:57.638152 21972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:44405 every 8 connection(s)
I20260807 06:55:57.639734 21806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:55:57.646921 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 21806
Aug 07 06:55:57 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085757, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.189@KRBTEST.COM
Aug 07 06:55:57 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085757, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.188@KRBTEST.COM
I20260807 06:55:57.688691 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.643018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:44269 (local address 127.10.191.189:38837)
0807 06:55:57.654129 (+ 11111us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.654138 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.662675 (+ 8537us) server_negotiation.cc:407] Connection header received
0807 06:55:57.662954 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.662960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.663045 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.663120 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.667094 (+ 3974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.668724 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.673104 (+ 4380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.673791 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.673901 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.680397 (+ 6496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.680404 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.680410 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.680487 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.683814 (+ 3327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.684994 (+ 1180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.685002 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.685007 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.685212 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.685876 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.685882 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.685885 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.686303 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.686494 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.687923 (+ 1429us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.688239 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10914,"thread_start_us":10780,"threads_started":1}
I20260807 06:55:57.692154 21981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.643522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.10.191.131:44269)
0807 06:55:57.662557 (+ 19035us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.662577 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.662805 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.663906 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.663921 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.665420 (+ 1499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:57.666724 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.666763 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.669089 (+ 2326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.669098 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.672907 (+ 3809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.672926 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.674364 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.674372 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.674677 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.675548 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:57.675599 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:57.680063 (+ 4464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:57.683977 (+ 3914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.683992 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.684021 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.684821 (+ 800us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.685413 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.685417 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.685420 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.685736 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.686699 (+ 963us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:57.686709 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:57.687252 (+ 543us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.689846 (+ 2594us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.690473 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18816,"mutex_wait_us":40,"spinlock_wait_cycles":51072,"thread_start_us":17337,"threads_started":1}
I20260807 06:55:57.694679 21976 heartbeater.cc:347] Connected to a master server at 127.10.191.189:38837
I20260807 06:55:57.695184 21976 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:57.696422 21976 heartbeater.cc:511] Master 127.10.191.189:38837 requested a full tablet report, sending...
I20260807 06:55:57.698868 21079 ts_manager.cc:194] Registered new tserver with Master: 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405)
I20260807 06:55:57.699738 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.642679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:37293 (local address 127.10.191.188:36009)
0807 06:55:57.658700 (+ 16021us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.658710 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.660126 (+ 1416us) server_negotiation.cc:407] Connection header received
0807 06:55:57.662820 (+ 2694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.662826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.662928 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.663030 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.672333 (+ 9303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.673384 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.677546 (+ 4162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.678046 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.678125 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.689056 (+ 10931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.689063 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.689067 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.689136 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.693379 (+ 4243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.694910 (+ 1531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.694916 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.694919 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.695108 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.696553 (+ 1445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.696559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.696561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.696931 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.697036 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.699096 (+ 2060us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.699348 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15827,"thread_start_us":16043,"threads_started":1}
I20260807 06:55:57.700920 21982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.643522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:36009 (local address 127.10.191.131:37293)
0807 06:55:57.659897 (+ 16375us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.659970 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.662451 (+ 2481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.669644 (+ 7193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.669649 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.671198 (+ 1549us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:57.671527 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.671539 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.673619 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.673624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.677031 (+ 3407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.677048 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.679011 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.679019 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.679213 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.680601 (+ 1388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:57.680624 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:57.687198 (+ 6574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:57.693581 (+ 6383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.693603 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.693607 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.694590 (+ 983us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.695809 (+ 1219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.695813 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.695817 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.696031 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.698334 (+ 2303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:57.698338 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:57.698480 (+ 142us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.700135 (+ 1655us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.700457 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15883,"mutex_wait_us":1,"thread_start_us":18872,"threads_started":1}
Aug 07 06:55:57 dist-test-slave-tfpf krb5kdc[20196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085757, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:55:57.711792 21973 heartbeater.cc:347] Connected to a master server at 127.10.191.188:36009
I20260807 06:55:57.712005 21973 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:57.712632 21973 heartbeater.cc:511] Master 127.10.191.188:36009 requested a full tablet report, sending...
I20260807 06:55:57.714408 21347 ts_manager.cc:194] Registered new tserver with Master: 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405)
I20260807 06:55:57.720046 21981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.663221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.131:52649)
0807 06:55:57.695108 (+ 31887us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.695129 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.695233 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.695643 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.695647 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.696357 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:55:57.696695 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.696709 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.699582 (+ 2873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.699587 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.701779 (+ 2192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.701804 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.702574 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.702580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.702783 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.703537 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:55:57.703590 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:55:57.708169 (+ 4579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:55:57.715034 (+ 6865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.715039 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.715043 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.715454 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.717958 (+ 2504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:55:57.717962 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:55:57.717966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:55:57.718151 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:55:57.718949 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:55:57.718956 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:55:57.719123 (+ 167us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.719269 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.719613 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31725,"thread_start_us":47373,"threads_started":1}
I20260807 06:55:57.720074 21992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.663567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:52649 (local address 127.10.191.190:37753)
0807 06:55:57.688403 (+ 24836us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.688410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.695294 (+ 6884us) server_negotiation.cc:407] Connection header received
0807 06:55:57.695410 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.695415 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.695496 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.695620 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.697190 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.698128 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.701972 (+ 3844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.702400 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.702554 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.708422 (+ 5868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.708431 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.708437 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.708495 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.712639 (+ 4144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.715701 (+ 3062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.715712 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.715714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.715899 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.718311 (+ 2412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.718317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.718320 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.718720 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.718873 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.719392 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.719642 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24704,"thread_start_us":24943,"threads_started":1}
I20260807 06:55:57.721030 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.662432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49802 (local address 127.10.191.189:38837)
0807 06:55:57.689387 (+ 26955us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.689393 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.689410 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:55:57.689473 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.689479 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.689558 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.689659 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.705888 (+ 16229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.706900 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.708769 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.709340 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.709476 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.713666 (+ 4190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.713673 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.713679 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.713730 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.717345 (+ 3615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.718252 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.718259 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.718263 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.718439 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.718939 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.718944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.718947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.719294 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.719522 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.720471 (+ 949us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.720699 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26847,"thread_start_us":40225,"threads_started":1}
I20260807 06:55:57.721407 21974 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37753
I20260807 06:55:57.721534 21974 heartbeater.cc:464] Registering TS with master...
I20260807 06:55:57.722072 21974 heartbeater.cc:511] Master 127.10.191.190:37753 requested a full tablet report, sending...
I20260807 06:55:57.723351 20255 ts_manager.cc:194] Re-registered known tserver with Master: 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405)
I20260807 06:55:57.724634 20255 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:52649
I20260807 06:55:57.731842 21996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.688702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37372 (local address 127.10.191.190:37753)
0807 06:55:57.706318 (+ 17616us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.706324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.709202 (+ 2878us) server_negotiation.cc:407] Connection header received
0807 06:55:57.709379 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.709386 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.709477 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.709579 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.715764 (+ 6185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.717045 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.719116 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.719789 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.719951 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.725600 (+ 5649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.725608 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.725615 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.725659 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.728868 (+ 3209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.729693 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.729698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.729701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.729853 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.730236 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.730242 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.730245 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.730561 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.730821 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.731221 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.731446 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17499,"thread_start_us":15766,"threads_started":1}
I20260807 06:55:57.732406 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.688117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41646 (local address 127.10.191.188:36009)
0807 06:55:57.700071 (+ 11954us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.700077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.715011 (+ 14934us) server_negotiation.cc:407] Connection header received
0807 06:55:57.715925 (+ 914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.715932 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.716053 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.716104 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:57.717928 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.718941 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.721885 (+ 2944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.722414 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.722552 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.726559 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:57.726565 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:57.726570 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:57.726635 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:57.729524 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.730297 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.730301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.730303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.730431 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:57.730841 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:57.730847 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:57.730852 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:57.731269 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:57.731488 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.731850 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.732097 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11853,"thread_start_us":21825,"threads_started":1}
I20260807 06:55:57.736065 20255 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37372:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:57.743706 20255 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:57.790197 22017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.765220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36556 (local address 127.10.191.131:44405)
0807 06:55:57.782106 (+ 16886us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.782112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.782142 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:55:57.782227 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.782232 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.782446 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.782688 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:57.783806 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.784915 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.787055 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.788843 (+ 1788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.789091 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.789339 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.789588 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.789820 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16711,"thread_start_us":16529,"threads_started":1}
I20260807 06:55:57.790270 22015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.764838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:44405 (local address 127.0.0.1:36556)
0807 06:55:57.780153 (+ 15315us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.780179 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.780364 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.783076 (+ 2712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.783081 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.783108 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:57.783505 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.783519 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.785095 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.785102 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.786874 (+ 1772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.786892 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.789218 (+ 2326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.789224 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.789385 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.789421 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.789515 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.789645 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15129,"mutex_wait_us":4,"thread_start_us":15621,"threads_started":1}
I20260807 06:55:57.793596 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.765135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:33051 (local address 127.0.0.1:55406)
0807 06:55:57.785546 (+ 20411us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.785568 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.785688 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.786445 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.786454 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.786480 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:57.786904 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.786912 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.788324 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.788328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.790991 (+ 2663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.791009 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.792777 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.792783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.792953 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.792995 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.793128 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.793254 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20278,"thread_start_us":20087,"threads_started":1}
I20260807 06:55:57.793640 22018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.765808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55406 (local address 127.10.191.129:33051)
0807 06:55:57.781566 (+ 15758us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.781579 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.785726 (+ 4147us) server_negotiation.cc:407] Connection header received
0807 06:55:57.785865 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.785876 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.786194 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.786441 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:57.787117 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.788109 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.791177 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.792570 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.792750 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.792925 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.793173 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.793329 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15581,"thread_start_us":15463,"threads_started":1}
I20260807 06:55:57.795100 21890 tablet_service.cc:1467] Processing CreateTablet for tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 (DEFAULT_TABLE table=test-table [id=9c639daaaddf4e37a72b2337119f5250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:57.796813 21890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:57.799022 22019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.765803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:45945 (local address 127.0.0.1:47168)
0807 06:55:57.791011 (+ 25208us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.791026 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.791195 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.791946 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.791950 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.791984 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:57.792349 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.792360 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.794091 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.794096 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.795994 (+ 1898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.796011 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.798118 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.798125 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.798316 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.798351 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.798451 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.798602 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25081,"thread_start_us":26294,"threads_started":1}
I20260807 06:55:57.799137 22021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.766445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47168 (local address 127.10.191.130:45945)
0807 06:55:57.790344 (+ 23899us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.790356 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.791332 (+ 976us) server_negotiation.cc:407] Connection header received
0807 06:55:57.791442 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.791450 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.791716 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.791939 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:57.792546 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.793944 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.796174 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.797613 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.797790 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.797974 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.798558 (+ 584us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.798811 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23709,"thread_start_us":23919,"threads_started":1}
I20260807 06:55:57.804060 21520 tablet_service.cc:1467] Processing CreateTablet for tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 (DEFAULT_TABLE table=test-table [id=9c639daaaddf4e37a72b2337119f5250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:57.803886 21709 tablet_service.cc:1467] Processing CreateTablet for tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 (DEFAULT_TABLE table=test-table [id=9c639daaaddf4e37a72b2337119f5250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:57.805428 21709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:57.805425 21520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:57.813896 22023 tablet_bootstrap.cc:492] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: Bootstrap starting.
I20260807 06:55:57.818074 22025 tablet_bootstrap.cc:492] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: Bootstrap starting.
I20260807 06:55:57.818518 22023 tablet_bootstrap.cc:654] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:57.819640 22023 log.cc:824] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:57.822118 22025 tablet_bootstrap.cc:654] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:57.822754 22023 tablet_bootstrap.cc:492] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: No bootstrap required, opened a new log
I20260807 06:55:57.823019 22023 ts_tablet_manager.cc:1397] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 06:55:57.823220 22025 log.cc:824] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:57.826011 22025 tablet_bootstrap.cc:492] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: No bootstrap required, opened a new log
I20260807 06:55:57.826265 22025 ts_tablet_manager.cc:1397] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260807 06:55:57.821051 22026 tablet_bootstrap.cc:492] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: Bootstrap starting.
I20260807 06:55:57.831295 22023 raft_consensus.cc:348] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } }
I20260807 06:55:57.831832 22023 raft_consensus.cc:374] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:57.831944 22023 raft_consensus.cc:729] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d7f9c5340984028adb8636ff0e3faec, State: Initialized, Role: FOLLOWER
I20260807 06:55:57.832633 22023 consensus_queue.cc:260] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } }
I20260807 06:55:57.833196 22026 tablet_bootstrap.cc:654] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:57.834807 22023 ts_tablet_manager.cc:1428] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260807 06:55:57.834808 22026 log.cc:824] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: Log is configured to *not* fsync() on all Append() calls
I20260807 06:55:57.834782 22025 raft_consensus.cc:348] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } }
I20260807 06:55:57.835167 21974 heartbeater.cc:503] Master 127.10.191.190:37753 was elected leader, sending a full tablet report...
I20260807 06:55:57.835253 22025 raft_consensus.cc:374] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:57.835371 22025 raft_consensus.cc:729] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8646bd931bb404abe5167e704296b3e, State: Initialized, Role: FOLLOWER
I20260807 06:55:57.837860 22025 consensus_queue.cc:260] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } }
I20260807 06:55:57.842610 22025 ts_tablet_manager.cc:1428] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260807 06:55:57.843592 22026 tablet_bootstrap.cc:492] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: No bootstrap required, opened a new log
I20260807 06:55:57.843950 22026 ts_tablet_manager.cc:1397] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.003s
I20260807 06:55:57.851783 22026 raft_consensus.cc:348] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } }
I20260807 06:55:57.852245 22026 raft_consensus.cc:374] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:57.852365 22026 raft_consensus.cc:729] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dee1f504ab3b4a02a1e465ea780a3b9c, State: Initialized, Role: FOLLOWER
I20260807 06:55:57.852970 22026 consensus_queue.cc:260] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } }
I20260807 06:55:57.854152 21791 heartbeater.cc:503] Master 127.10.191.190:37753 was elected leader, sending a full tablet report...
I20260807 06:55:57.854883 22026 ts_tablet_manager.cc:1428] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: Time spent starting tablet: real 0.011s user 0.008s sys 0.003s
W20260807 06:55:57.866132 21614 tablet.cc:2369] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:55:57.893241 21978 tablet.cc:2369] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:55:57.963706 22033 raft_consensus.cc:482] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:57.964020 22033 raft_consensus.cc:504] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } }
I20260807 06:55:57.966214 22033 leader_election.cc:288] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405), c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051)
I20260807 06:55:57.973127 22017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.966591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:56437 (local address 127.10.191.131:44405)
0807 06:55:57.966830 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.966839 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.967589 (+ 750us) server_negotiation.cc:407] Connection header received
0807 06:55:57.967824 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.967831 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.967902 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.967993 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:57.968734 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.969599 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.971328 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.972126 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.972352 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.972452 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.972681 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.972828 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:55:57.973198 22035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.966622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:44405 (local address 127.10.191.130:56437)
0807 06:55:57.967471 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.967486 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.967643 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.968142 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.968145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.968163 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:57.968532 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.968544 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.969745 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.969748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.971152 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.971166 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.972361 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.972366 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.972519 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.972545 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.972621 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.972740 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":3,"thread_start_us":501,"threads_started":1}
I20260807 06:55:57.973212 22018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.966932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:42263 (local address 127.10.191.129:33051)
0807 06:55:57.967144 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:57.967149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:57.967378 (+ 229us) server_negotiation.cc:407] Connection header received
0807 06:55:57.967666 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:57.967670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:57.967763 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:57.967854 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:57.968506 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.969327 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.971341 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.972122 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.972318 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.972401 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:57.972806 (+ 405us) server_negotiation.cc:299] Negotiation successful
0807 06:55:57.972945 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:55:57.973289 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:57.966492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:33051 (local address 127.10.191.130:42263)
0807 06:55:57.967258 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:57.967287 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:57.967494 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:57.967891 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:57.967897 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:57.967947 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:57.968341 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.968351 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.969474 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.969480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.971155 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:57.971168 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:57.972439 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:57.972446 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:57.972594 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:57.972654 (+ 60us) client_negotiation.cc:769] Sending connection context
0807 06:55:57.972752 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:55:57.972874 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":660,"threads_started":1}
I20260807 06:55:57.974455 21547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5eb9183af5f4bd0a2b3b4fdd2ccfdf0" candidate_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8646bd931bb404abe5167e704296b3e" is_pre_election: true
I20260807 06:55:57.974512 21912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5eb9183af5f4bd0a2b3b4fdd2ccfdf0" candidate_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d7f9c5340984028adb8636ff0e3faec" is_pre_election: true
I20260807 06:55:57.975023 21547 raft_consensus.cc:2454] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dee1f504ab3b4a02a1e465ea780a3b9c in term 0.
I20260807 06:55:57.975106 21912 raft_consensus.cc:2454] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dee1f504ab3b4a02a1e465ea780a3b9c in term 0.
I20260807 06:55:57.975816 21648 leader_election.cc:302] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6d7f9c5340984028adb8636ff0e3faec, c8646bd931bb404abe5167e704296b3e, dee1f504ab3b4a02a1e465ea780a3b9c; no voters:
I20260807 06:55:57.976301 22033 raft_consensus.cc:2781] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:57.976454 22033 raft_consensus.cc:482] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:57.976572 22033 raft_consensus.cc:3037] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:57.978883 22033 raft_consensus.cc:504] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } }
I20260807 06:55:57.979533 22033 leader_election.cc:288] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [CANDIDATE]: Term 1 election: Requested vote from peers 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405), c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051)
I20260807 06:55:57.980101 21912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5eb9183af5f4bd0a2b3b4fdd2ccfdf0" candidate_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d7f9c5340984028adb8636ff0e3faec"
I20260807 06:55:57.980127 21547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5eb9183af5f4bd0a2b3b4fdd2ccfdf0" candidate_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8646bd931bb404abe5167e704296b3e"
I20260807 06:55:57.980350 21547 raft_consensus.cc:3037] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:57.980322 21912 raft_consensus.cc:3037] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:57.983165 21547 raft_consensus.cc:2454] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dee1f504ab3b4a02a1e465ea780a3b9c in term 1.
I20260807 06:55:57.983352 21912 raft_consensus.cc:2454] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dee1f504ab3b4a02a1e465ea780a3b9c in term 1.
I20260807 06:55:57.983788 21651 leader_election.cc:302] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8646bd931bb404abe5167e704296b3e, dee1f504ab3b4a02a1e465ea780a3b9c; no voters:
I20260807 06:55:57.984143 22033 raft_consensus.cc:2781] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:57.984637 22033 raft_consensus.cc:686] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 LEADER]: Becoming Leader. State: Replica: dee1f504ab3b4a02a1e465ea780a3b9c, State: Running, Role: LEADER
I20260807 06:55:57.985498 22033 consensus_queue.cc:237] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } }
I20260807 06:55:57.990720 20255 catalog_manager.cc:5495] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c reported cstate change: term changed from 0 to 1, leader changed from <none> to dee1f504ab3b4a02a1e465ea780a3b9c (127.10.191.130). New cstate: current_term: 1 leader_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } health_report { overall_health: HEALTHY } } }
I20260807 06:55:58.017632 22021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:58.011783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47174 (local address 127.10.191.130:45945)
0807 06:55:58.011985 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:58.011989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:58.012006 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:55:58.012145 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:58.012148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:58.012238 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:58.012378 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:58.012691 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.013474 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.015426 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.015838 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.015925 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:58.016470 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:58.016994 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:58.017199 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:58.017255 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 06:55:58.017328 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 06:55:58.019381 21793 tablet.cc:2369] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:55:58.026763 21912 raft_consensus.cc:1261] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [term 1 FOLLOWER]: Refusing update from remote peer dee1f504ab3b4a02a1e465ea780a3b9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:58.026804 21547 raft_consensus.cc:1261] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [term 1 FOLLOWER]: Refusing update from remote peer dee1f504ab3b4a02a1e465ea780a3b9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:58.027737 22036 consensus_queue.cc:1035] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:58.028092 22033 consensus_queue.cc:1035] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:58.043767 22044 mvcc.cc:205] Tried to move back new op lower bound from 7315807264866672640 to 7315807264712986624. Current Snapshot: MvccSnapshot[applied={T|T < 7315807264866672640}]
I20260807 06:55:58.067751 20255 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:58.068014 20255 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:58.074609 20255 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f15d78b0aac40c79a4d3cf03f8b9d03: Sending DeleteTablet for 3 replicas of tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0
I20260807 06:55:58.075822 21890 tablet_service.cc:1514] Processing DeleteTablet for tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:58 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:36556
I20260807 06:55:58.076188 21520 tablet_service.cc:1514] Processing DeleteTablet for tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:58 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:55406
I20260807 06:55:58.076785 21709 tablet_service.cc:1514] Processing DeleteTablet for tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:58 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:47168
I20260807 06:55:58.077399 22055 tablet_replica.cc:330] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: stopping tablet replica
I20260807 06:55:58.078048 22055 raft_consensus.cc:2229] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:58.078827 22055 raft_consensus.cc:2258] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:58.080003 22056 tablet_replica.cc:330] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: stopping tablet replica
I20260807 06:55:58.080477 22056 raft_consensus.cc:2229] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:58.081296 22056 raft_consensus.cc:2258] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:58.083252 22056 ts_tablet_manager.cc:1905] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:58.087124 22055 ts_tablet_manager.cc:1905] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:58.090353 22056 ts_tablet_manager.cc:1918] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:58.091136 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 20212
I20260807 06:55:58.091547 22056 log.cc:1196] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/e5eb9183af5f4bd0a2b3b4fdd2ccfdf0
I20260807 06:55:58.092201 22056 ts_tablet_manager.cc:1939] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P dee1f504ab3b4a02a1e465ea780a3b9c: Deleting consensus metadata
I20260807 06:55:58.092396 20297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:55:58.097613 22055 ts_tablet_manager.cc:1918] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:58.097836 22055 log.cc:1196] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/e5eb9183af5f4bd0a2b3b4fdd2ccfdf0
I20260807 06:55:58.098340 22055 ts_tablet_manager.cc:1939] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P c8646bd931bb404abe5167e704296b3e: Deleting consensus metadata
I20260807 06:55:58.101043 22054 tablet_replica.cc:330] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: stopping tablet replica
I20260807 06:55:58.101529 22054 raft_consensus.cc:2229] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:58.104363 22054 raft_consensus.cc:2258] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:58.107323 22054 ts_tablet_manager.cc:1905] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:58.114136 22054 ts_tablet_manager.cc:1918] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:58.114365 22054 log.cc:1196] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/e5eb9183af5f4bd0a2b3b4fdd2ccfdf0
I20260807 06:55:58.114941 22054 ts_tablet_manager.cc:1939] T e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 P 6d7f9c5340984028adb8636ff0e3faec: Deleting consensus metadata
I20260807 06:55:58.120697 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:58.080793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49818 (local address 127.10.191.189:38837)
0807 06:55:58.080971 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:58.080977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:58.089779 (+ 8802us) server_negotiation.cc:407] Connection header received
0807 06:55:58.090148 (+ 369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:58.090154 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:58.090261 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:58.090343 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:58.100579 (+ 10236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.101680 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.104250 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.104946 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.105104 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:58.113291 (+ 8187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:58.113298 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:58.113302 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:58.113355 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:58.117304 (+ 3949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:58.118285 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:58.118291 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:58.118295 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:58.118487 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:58.118956 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:58.118961 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:58.118966 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:58.119345 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:58.119597 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:58.120038 (+ 441us) server_negotiation.cc:299] Negotiation successful
0807 06:55:58.120276 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:55:58.140038 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:58.090147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41656 (local address 127.10.191.188:36009)
0807 06:55:58.090331 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:58.090344 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:58.120895 (+ 30551us) server_negotiation.cc:407] Connection header received
0807 06:55:58.121223 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:58.121231 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:58.121333 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:58.121399 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:58.123863 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.125036 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.126873 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.127505 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.127635 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:58.131295 (+ 3660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:58.131303 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:58.131308 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:58.131354 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:58.136203 (+ 4849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:58.137153 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:58.137159 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:58.137170 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:58.137330 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:58.137782 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:58.137787 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:58.137790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:58.138193 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:58.138463 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:58.139404 (+ 941us) server_negotiation.cc:299] Negotiation successful
0807 06:55:58.139673 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:55:58.232510 20238 catalog_manager.cc:4841] TS c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051): tablet e5eb9183af5f4bd0a2b3b4fdd2ccfdf0 (table test-table [id=9c639daaaddf4e37a72b2337119f5250]) successfully deleted
W20260807 06:55:58.232858 20238 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.191.129:33051, user_credentials={real_user=slave}} blocked reactor thread for 132827us
I20260807 06:55:58.233337 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 20212
I20260807 06:55:58.288640 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:58.270226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49828 (local address 127.10.191.189:38837)
0807 06:55:58.270481 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:58.270490 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:58.271503 (+ 1013us) server_negotiation.cc:407] Connection header received
0807 06:55:58.272391 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:58.272397 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:58.272486 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:58.272581 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:58.274724 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.275542 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.276947 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.277600 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.277754 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:58.281762 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:58.281768 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:58.281771 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:58.281839 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:58.285612 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:58.286357 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:58.286364 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:58.286368 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:58.286549 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:58.287012 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:58.287017 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:58.287021 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:58.287447 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:58.287732 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:58.288059 (+ 327us) server_negotiation.cc:299] Negotiation successful
0807 06:55:58.288296 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:55:58.289844 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:58.271234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41660 (local address 127.10.191.188:36009)
0807 06:55:58.271429 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:58.271438 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:58.272026 (+ 588us) server_negotiation.cc:407] Connection header received
0807 06:55:58.272231 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:58.272236 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:58.272329 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:58.272444 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:58.274102 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.274997 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.276976 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:58.277745 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:58.277851 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:58.281734 (+ 3883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:58.281740 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:58.281745 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:58.281793 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:58.285022 (+ 3229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:58.285945 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:58.285951 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:58.285954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:58.286110 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:58.286572 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:58.286579 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:58.286587 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:58.287082 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:58.287356 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:58.289268 (+ 1912us) server_negotiation.cc:299] Negotiation successful
0807 06:55:58.289517 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 06:55:59.051891 22070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.050880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.129:43309)
0807 06:55:59.051438 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.051617 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":296,"threads_started":1}
W20260807 06:55:59.052410 21612 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:37753 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
I20260807 06:55:59.053903 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.052922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.131:38939)
0807 06:55:59.053441 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.053658 (+ 217us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":292,"threads_started":1}
W20260807 06:55:59.054296 21974 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:37753 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
I20260807 06:55:59.062561 22073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.061901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.130:51093)
0807 06:55:59.062303 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.062405 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":232,"threads_started":1}
W20260807 06:55:59.062932 21791 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:37753 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
I20260807 06:55:59.575559 22075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f15d78b0aac40c79a4d3cf03f8b9d03)
I20260807 06:55:59.575924 22075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } }
I20260807 06:55:59.576368 22077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7f15d78b0aac40c79a4d3cf03f8b9d03)
I20260807 06:55:59.576617 22077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } }
I20260807 06:55:59.577575 22075 leader_election.cc:288] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f15d78b0aac40c79a4d3cf03f8b9d03 (127.10.191.190:37753), 3ed91052c0ce4d28aede4dcc49a6ddff (127.10.191.189:38837)
I20260807 06:55:59.578157 22077 leader_election.cc:288] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f15d78b0aac40c79a4d3cf03f8b9d03 (127.10.191.190:37753), 6416467a71f24cd49cd29edc8edcb6e2 (127.10.191.188:36009)
I20260807 06:55:59.579341 22079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.577803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37824)
0807 06:55:59.578791 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.579008 (+ 217us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":823,"threads_started":1}
I20260807 06:55:59.580968 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.578286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37832)
0807 06:55:59.580383 (+ 2097us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.580617 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1947,"thread_start_us":1775,"threads_started":1}
W20260807 06:55:59.583555 21063 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
I20260807 06:55:59.591902 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.580523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:36009 (local address 127.0.0.1:41672)
0807 06:55:59.581187 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.581205 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:59.581367 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:59.582325 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:59.582333 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:59.582370 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:59.582722 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.582736 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.585064 (+ 2328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.585072 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.587802 (+ 2730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.587826 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.590482 (+ 2656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.590492 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.590865 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.590929 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 06:55:59.591081 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 06:55:59.591352 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":2648,"threads_started":1}
I20260807 06:55:59.592847 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.592429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37836)
0807 06:55:59.592577 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.592669 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 06:55:59.593560 21063 leader_election.cc:334] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f15d78b0aac40c79a4d3cf03f8b9d03 (127.10.191.190:37753): Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
I20260807 06:55:59.593853 22083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.581048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41672 (local address 127.10.191.188:36009)
0807 06:55:59.581916 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:59.581925 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:59.581948 (+ 23us) server_negotiation.cc:407] Connection header received
0807 06:55:59.582033 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:59.582040 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:59.582140 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:59.582877 (+ 737us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:59.583209 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.584823 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.588131 (+ 3308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.590081 (+ 1950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.593171 (+ 3090us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.593255 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:59.593313 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 06:55:59.593453 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":556,"threads_started":1}
I20260807 06:55:59.594978 21362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6416467a71f24cd49cd29edc8edcb6e2" is_pre_election: true
W20260807 06:55:59.594990 21325 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
I20260807 06:55:59.595436 21362 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ed91052c0ce4d28aede4dcc49a6ddff in term 1.
I20260807 06:55:59.596243 21063 leader_election.cc:302] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed91052c0ce4d28aede4dcc49a6ddff, 6416467a71f24cd49cd29edc8edcb6e2; no voters: 7f15d78b0aac40c79a4d3cf03f8b9d03
I20260807 06:55:59.596669 22077 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 06:55:59.596856 22077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7f15d78b0aac40c79a4d3cf03f8b9d03)
I20260807 06:55:59.596964 22077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:55:59.597752 22078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.597117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37866)
0807 06:55:59.597280 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.597464 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 06:55:59.597793 22079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.577814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38837 (local address 127.0.0.1:49836)
0807 06:55:59.579562 (+ 1748us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.579584 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:59.579767 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:59.588998 (+ 9231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:59.589008 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:59.589047 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:59.589575 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.589694 (+ 119us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.592085 (+ 2391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.592092 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.594222 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.594243 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.596658 (+ 2415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.596684 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.596943 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.596993 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 06:55:59.597148 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 06:55:59.597319 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1635,"mutex_wait_us":93,"thread_start_us":563,"threads_started":1}
I20260807 06:55:59.597785 22080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.578017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49836 (local address 127.10.191.189:38837)
0807 06:55:59.588393 (+ 10376us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:59.588401 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:59.588426 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:55:59.588502 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:59.588510 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:59.588599 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:59.589918 (+ 1319us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:59.590309 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.591901 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.594895 (+ 2994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.596343 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.596720 (+ 377us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.596831 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:59.597180 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 06:55:59.597334 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10211,"thread_start_us":10687,"threads_started":1}
W20260807 06:55:59.598057 21325 leader_election.cc:334] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7f15d78b0aac40c79a4d3cf03f8b9d03 (127.10.191.190:37753): Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
I20260807 06:55:59.598848 21093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6416467a71f24cd49cd29edc8edcb6e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" is_pre_election: true
I20260807 06:55:59.600016 22077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } }
I20260807 06:55:59.600546 21093 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6416467a71f24cd49cd29edc8edcb6e2 in current term 2: Already voted for candidate 3ed91052c0ce4d28aede4dcc49a6ddff in this term.
I20260807 06:55:59.600960 22077 leader_election.cc:288] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [CANDIDATE]: Term 2 election: Requested vote from peers 7f15d78b0aac40c79a4d3cf03f8b9d03 (127.10.191.190:37753), 6416467a71f24cd49cd29edc8edcb6e2 (127.10.191.188:36009)
I20260807 06:55:59.601527 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.601007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37872)
0807 06:55:59.601202 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.601337 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 06:55:59.601629 21362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6416467a71f24cd49cd29edc8edcb6e2"
I20260807 06:55:59.601816 21323 leader_election.cc:302] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6416467a71f24cd49cd29edc8edcb6e2; no voters: 3ed91052c0ce4d28aede4dcc49a6ddff, 7f15d78b0aac40c79a4d3cf03f8b9d03
I20260807 06:55:59.601917 21362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:55:59.602562 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.602247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37882)
0807 06:55:59.602384 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.602456 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 06:55:59.602780 21063 leader_election.cc:334] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7f15d78b0aac40c79a4d3cf03f8b9d03 (127.10.191.190:37753): Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
I20260807 06:55:59.604250 21362 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ed91052c0ce4d28aede4dcc49a6ddff in term 2.
I20260807 06:55:59.604524 22075 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 06:55:59.604779 21063 leader_election.cc:302] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ed91052c0ce4d28aede4dcc49a6ddff, 6416467a71f24cd49cd29edc8edcb6e2; no voters: 7f15d78b0aac40c79a4d3cf03f8b9d03
I20260807 06:55:59.605105 22077 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:55:59.605543 22077 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [term 2 LEADER]: Becoming Leader. State: Replica: 3ed91052c0ce4d28aede4dcc49a6ddff, State: Running, Role: LEADER
I20260807 06:55:59.605949 22077 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } }
I20260807 06:55:59.607851 22087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ed91052c0ce4d28aede4dcc49a6ddff. Latest consensus state: current_term: 2 leader_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:59.608263 22087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:59.608870 22089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:55:59.612301 22089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:55:59.613157 22089 catalog_manager.cc:1259] Loaded cluster ID: 4c9482d971a9446eaae1b8bde6eaceb5
I20260807 06:55:59.613256 22089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:55:59.614478 22089 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:55:59.615317 22089 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Loaded TSK: 0
I20260807 06:55:59.616153 22089 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:55:59.651862 21077 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:55:59.659147 21077 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:55:59.663365 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.662995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37892)
0807 06:55:59.663150 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.663228 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 06:55:59.663862 21362 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [term 2 FOLLOWER]: Refusing update from remote peer 3ed91052c0ce4d28aede4dcc49a6ddff: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 06:55:59.664436 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.664050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37906)
0807 06:55:59.664241 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.664310 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 06:55:59.664707 21063 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff -> Peer 7f15d78b0aac40c79a4d3cf03f8b9d03 (127.10.191.190:37753): Couldn't send request to peer 7f15d78b0aac40c79a4d3cf03f8b9d03. Status: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 06:55:59.664739 22087 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [LEADER]: Connected to new peer: Peer: permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 06:55:59.667593 22075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ed91052c0ce4d28aede4dcc49a6ddff. Latest consensus state: current_term: 2 leader_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:59.667909 22075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:55:59.669034 22091 mvcc.cc:205] Tried to move back new op lower bound from 7315807271574986752 to 7315807271349841920. Current Snapshot: MvccSnapshot[applied={T|T < 7315807271574986752}]
I20260807 06:55:59.669684 22077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:59.670022 22077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff [sys.catalog]: This master's current role is: LEADER
I20260807 06:55:59.669986 22075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "7f15d78b0aac40c79a4d3cf03f8b9d03" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37753 } } peers { permanent_uuid: "3ed91052c0ce4d28aede4dcc49a6ddff" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38837 } attrs { promote: false } } peers { permanent_uuid: "6416467a71f24cd49cd29edc8edcb6e2" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 36009 } attrs { promote: false } } }
I20260807 06:55:59.670202 22075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6416467a71f24cd49cd29edc8edcb6e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:55:59.684851 22081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.678507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:45945 (local address 127.0.0.1:47188)
0807 06:55:59.679614 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.679632 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:59.679739 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:59.680113 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:59.680118 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:59.680141 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:59.680336 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.680344 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.681688 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.681694 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.683007 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.683020 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.684089 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.684095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.684282 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.684351 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 06:55:59.684446 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 06:55:59.684608 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":985,"thread_start_us":295,"threads_started":1}
I20260807 06:55:59.686168 22105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.679282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47188 (local address 127.10.191.130:45945)
0807 06:55:59.679761 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:59.679769 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:59.679789 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:55:59.679879 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:59.679883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:59.679967 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:59.680087 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:59.680486 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.681530 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.683181 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.683917 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.684104 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.684183 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:59.685578 (+ 1395us) server_negotiation.cc:299] Negotiation successful
0807 06:55:59.685744 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":554,"threads_started":1}
I20260807 06:55:59.686879 21709 tablet_service.cc:1467] Processing CreateTablet for tablet 48462f2d3a8644cf8f58da53102303f1 (DEFAULT_TABLE table=test-table [id=8b6fc051768f42fda5840d0b03c0097c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:59.687350 21709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48462f2d3a8644cf8f58da53102303f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:59.692807 22110 tablet_bootstrap.cc:492] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: Bootstrap starting.
I20260807 06:55:59.695233 22110 tablet_bootstrap.cc:654] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:59.697831 22110 tablet_bootstrap.cc:492] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: No bootstrap required, opened a new log
I20260807 06:55:59.698004 22110 ts_tablet_manager.cc:1397] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 06:55:59.698149 22082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.677551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:33051 (local address 127.0.0.1:55420)
0807 06:55:59.678881 (+ 1330us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.678903 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:59.679036 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:59.691656 (+ 12620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:59.691664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:59.691696 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:59.692067 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.692086 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.693525 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.693530 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.695734 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.695746 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.697361 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.697369 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.697530 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.697570 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 06:55:59.697643 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:55:59.697794 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1143,"mutex_wait_us":51}
I20260807 06:55:59.699011 22102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.678018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55420 (local address 127.10.191.129:33051)
0807 06:55:59.691209 (+ 13191us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:59.691219 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:59.691247 (+ 28us) server_negotiation.cc:407] Connection header received
0807 06:55:59.691347 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:59.691354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:59.691455 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:59.691602 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:59.692280 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.693340 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.695919 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.697070 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.698447 (+ 1377us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.698522 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:59.698574 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 06:55:59.698705 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12995,"thread_start_us":13729,"threads_started":1}
I20260807 06:55:59.699048 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.678425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:44405 (local address 127.0.0.1:36564)
0807 06:55:59.679081 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.679098 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:55:59.679190 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:55:59.692578 (+ 13388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:55:59.692583 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:55:59.692606 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:55:59.692935 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.692946 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.694635 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.694641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.696774 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:55:59.696786 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.698327 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.698334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:55:59.698489 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.698511 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:55:59.698612 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 06:55:59.698750 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"mutex_wait_us":32}
I20260807 06:55:59.699045 22104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.678544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36564 (local address 127.10.191.131:44405)
0807 06:55:59.692238 (+ 13694us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:59.692244 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:59.692260 (+ 16us) server_negotiation.cc:407] Connection header received
0807 06:55:59.692324 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:59.692330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:59.692421 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:59.693119 (+ 698us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:55:59.693293 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.694457 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.696942 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.697864 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.698049 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.698121 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:59.698637 (+ 516us) server_negotiation.cc:299] Negotiation successful
0807 06:55:59.698784 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13549,"thread_start_us":13442,"threads_started":1}
I20260807 06:55:59.698980 22110 raft_consensus.cc:348] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } }
I20260807 06:55:59.699237 22110 raft_consensus.cc:374] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:59.699329 22110 raft_consensus.cc:729] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dee1f504ab3b4a02a1e465ea780a3b9c, State: Initialized, Role: FOLLOWER
I20260807 06:55:59.699563 22110 consensus_queue.cc:260] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } }
I20260807 06:55:59.699770 21520 tablet_service.cc:1467] Processing CreateTablet for tablet 48462f2d3a8644cf8f58da53102303f1 (DEFAULT_TABLE table=test-table [id=8b6fc051768f42fda5840d0b03c0097c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:59.700112 21890 tablet_service.cc:1467] Processing CreateTablet for tablet 48462f2d3a8644cf8f58da53102303f1 (DEFAULT_TABLE table=test-table [id=8b6fc051768f42fda5840d0b03c0097c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:55:59.700282 21520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48462f2d3a8644cf8f58da53102303f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:59.700435 22110 ts_tablet_manager.cc:1428] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:55:59.700551 21890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 48462f2d3a8644cf8f58da53102303f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:55:59.705533 21792 heartbeater.cc:503] Master 127.10.191.189:38837 was elected leader, sending a full tablet report...
I20260807 06:55:59.706871 22117 tablet_bootstrap.cc:492] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: Bootstrap starting.
I20260807 06:55:59.707620 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.701494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.130:56439)
0807 06:55:59.706028 (+ 4534us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.706213 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3861,"thread_start_us":3713,"threads_started":1}
I20260807 06:55:59.708853 22117 tablet_bootstrap.cc:654] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:59.709703 22119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.708709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.130:46177)
0807 06:55:59.709286 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.709422 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"threads_started":1}
I20260807 06:55:59.712159 22117 tablet_bootstrap.cc:492] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: No bootstrap required, opened a new log
I20260807 06:55:59.712190 22118 tablet_bootstrap.cc:492] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: Bootstrap starting.
I20260807 06:55:59.712329 22117 ts_tablet_manager.cc:1397] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260807 06:55:59.713169 22117 raft_consensus.cc:348] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } }
I20260807 06:55:59.713428 22117 raft_consensus.cc:374] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:59.713534 22117 raft_consensus.cc:729] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8646bd931bb404abe5167e704296b3e, State: Initialized, Role: FOLLOWER
I20260807 06:55:59.713828 22117 consensus_queue.cc:260] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } }
I20260807 06:55:59.714689 22118 tablet_bootstrap.cc:654] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: Neither blocks nor log segments found. Creating new log.
I20260807 06:55:59.715425 22117 ts_tablet_manager.cc:1428] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 06:55:59.716786 22122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.715615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.129:57241)
0807 06:55:59.716272 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.716480 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":334,"threads_started":1}
I20260807 06:55:59.718523 22122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.718184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.129:57983)
0807 06:55:59.718303 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.718381 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 06:55:59.718568 21613 heartbeater.cc:503] Master 127.10.191.189:38837 was elected leader, sending a full tablet report...
I20260807 06:55:59.722450 22118 tablet_bootstrap.cc:492] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: No bootstrap required, opened a new log
I20260807 06:55:59.722596 22118 ts_tablet_manager.cc:1397] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260807 06:55:59.723215 22118 raft_consensus.cc:348] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } }
I20260807 06:55:59.723398 22118 raft_consensus.cc:374] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:55:59.723461 22118 raft_consensus.cc:729] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d7f9c5340984028adb8636ff0e3faec, State: Initialized, Role: FOLLOWER
I20260807 06:55:59.723709 22118 consensus_queue.cc:260] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } }
I20260807 06:55:59.724424 22118 ts_tablet_manager.cc:1428] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 06:55:59.726102 22126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.725129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.131:55337)
0807 06:55:59.725686 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.725863 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":280,"threads_started":1}
I20260807 06:55:59.726742 21976 heartbeater.cc:503] Master 127.10.191.189:38837 was elected leader, sending a full tablet report...
I20260807 06:55:59.727573 22126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.727217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.131:55643)
0807 06:55:59.727355 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.727442 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 06:55:59.838660 22112 raft_consensus.cc:482] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:55:59.838960 22112 raft_consensus.cc:504] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } }
I20260807 06:55:59.839839 22112 leader_election.cc:288] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051), 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405)
I20260807 06:55:59.840503 21912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48462f2d3a8644cf8f58da53102303f1" candidate_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d7f9c5340984028adb8636ff0e3faec" is_pre_election: true
I20260807 06:55:59.840503 21547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48462f2d3a8644cf8f58da53102303f1" candidate_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8646bd931bb404abe5167e704296b3e" is_pre_election: true
I20260807 06:55:59.840775 21912 raft_consensus.cc:2454] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dee1f504ab3b4a02a1e465ea780a3b9c in term 0.
I20260807 06:55:59.840773 21547 raft_consensus.cc:2454] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dee1f504ab3b4a02a1e465ea780a3b9c in term 0.
I20260807 06:55:59.841288 21651 leader_election.cc:302] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8646bd931bb404abe5167e704296b3e, dee1f504ab3b4a02a1e465ea780a3b9c; no voters:
I20260807 06:55:59.841588 22112 raft_consensus.cc:2781] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:55:59.841708 22112 raft_consensus.cc:482] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:55:59.841800 22112 raft_consensus.cc:3037] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:59.843822 22112 raft_consensus.cc:504] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } }
I20260807 06:55:59.844455 22112 leader_election.cc:288] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [CANDIDATE]: Term 1 election: Requested vote from peers c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051), 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405)
I20260807 06:55:59.845041 21547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48462f2d3a8644cf8f58da53102303f1" candidate_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8646bd931bb404abe5167e704296b3e"
I20260807 06:55:59.845117 21912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "48462f2d3a8644cf8f58da53102303f1" candidate_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d7f9c5340984028adb8636ff0e3faec"
I20260807 06:55:59.845331 21547 raft_consensus.cc:3037] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:59.845336 21912 raft_consensus.cc:3037] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:55:59.847381 21912 raft_consensus.cc:2454] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dee1f504ab3b4a02a1e465ea780a3b9c in term 1.
I20260807 06:55:59.847455 21547 raft_consensus.cc:2454] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dee1f504ab3b4a02a1e465ea780a3b9c in term 1.
I20260807 06:55:59.847816 21648 leader_election.cc:302] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d7f9c5340984028adb8636ff0e3faec, dee1f504ab3b4a02a1e465ea780a3b9c; no voters:
I20260807 06:55:59.848153 22112 raft_consensus.cc:2781] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:55:59.848632 22112 raft_consensus.cc:686] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 LEADER]: Becoming Leader. State: Replica: dee1f504ab3b4a02a1e465ea780a3b9c, State: Running, Role: LEADER
I20260807 06:55:59.848989 22112 consensus_queue.cc:237] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } }
I20260807 06:55:59.849866 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.849385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.130:55045)
0807 06:55:59.849564 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.849691 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 06:55:59.852224 21079 catalog_manager.cc:5495] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c reported cstate change: term changed from 0 to 1, leader changed from <none> to dee1f504ab3b4a02a1e465ea780a3b9c (127.10.191.130). New cstate: current_term: 1 leader_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dee1f504ab3b4a02a1e465ea780a3b9c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 45945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 } health_report { overall_health: UNKNOWN } } }
I20260807 06:55:59.881577 22105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.877229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47196 (local address 127.10.191.130:45945)
0807 06:55:59.877453 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:59.877458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:59.877473 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:55:59.877548 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:59.877552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:59.877623 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:59.877726 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:55:59.878093 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.878740 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.879994 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.880415 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.880539 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.880898 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:55:59.880996 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:55:59.881100 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:59.881245 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 06:55:59.881319 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 06:55:59.884963 21547 raft_consensus.cc:1261] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [term 1 FOLLOWER]: Refusing update from remote peer dee1f504ab3b4a02a1e465ea780a3b9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:59.884969 21912 raft_consensus.cc:1261] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [term 1 FOLLOWER]: Refusing update from remote peer dee1f504ab3b4a02a1e465ea780a3b9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:55:59.885712 22129 consensus_queue.cc:1035] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d7f9c5340984028adb8636ff0e3faec" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:59.886080 22112 consensus_queue.cc:1035] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8646bd931bb404abe5167e704296b3e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:55:59.888958 22122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.888284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.129:38293)
0807 06:55:59.888491 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.888670 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 06:55:59.889081 22126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.888559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.131:50375)
0807 06:55:59.888724 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.888870 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 06:55:59.900838 22126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.900212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.131:57505)
0807 06:55:59.900490 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.900619 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260807 06:55:59.902082 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.901139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.130:52203)
0807 06:55:59.901698 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.901844 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404}
I20260807 06:55:59.907833 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.905780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.130:39595)
0807 06:55:59.907559 (+ 1779us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.907658 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1657}
I20260807 06:55:59.908910 21077 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:59.909288 21077 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:55:59.909469 22122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.908925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.10.191.129:41017)
0807 06:55:59.909174 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 06:55:59.909284 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 06:55:59.917255 21077 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ed91052c0ce4d28aede4dcc49a6ddff: Sending DeleteTablet for 3 replicas of tablet 48462f2d3a8644cf8f58da53102303f1
I20260807 06:55:59.918509 21890 tablet_service.cc:1514] Processing DeleteTablet for tablet 48462f2d3a8644cf8f58da53102303f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:59 UTC) from {username='oryx', principal='oryx/127.10.191.189@KRBTEST.COM'} at 127.0.0.1:36564
I20260807 06:55:59.918704 21709 tablet_service.cc:1514] Processing DeleteTablet for tablet 48462f2d3a8644cf8f58da53102303f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:59 UTC) from {username='oryx', principal='oryx/127.10.191.189@KRBTEST.COM'} at 127.0.0.1:47188
I20260807 06:55:59.918776 21889 tablet_service.cc:1514] Processing DeleteTablet for tablet 48462f2d3a8644cf8f58da53102303f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:59 UTC) from {username='oryx', principal='oryx/127.10.191.189@KRBTEST.COM'} at 127.0.0.1:36564
I20260807 06:55:59.919241 21707 tablet_service.cc:1514] Processing DeleteTablet for tablet 48462f2d3a8644cf8f58da53102303f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:59 UTC) from {username='oryx', principal='oryx/127.10.191.189@KRBTEST.COM'} at 127.0.0.1:47188
I20260807 06:55:59.919327 21520 tablet_service.cc:1514] Processing DeleteTablet for tablet 48462f2d3a8644cf8f58da53102303f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:55:59 UTC) from {username='oryx', principal='oryx/127.10.191.189@KRBTEST.COM'} at 127.0.0.1:55420
I20260807 06:55:59.919559 22144 tablet_replica.cc:330] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: stopping tablet replica
I20260807 06:55:59.919831 22144 raft_consensus.cc:2229] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:55:59.920328 22144 raft_consensus.cc:2258] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:59.923094 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 21305
I20260807 06:55:59.925503 22144 ts_tablet_manager.cc:1905] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:59.935491 22144 ts_tablet_manager.cc:1918] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:59.935758 22144 log.cc:1196] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/48462f2d3a8644cf8f58da53102303f1
I20260807 06:55:59.936427 22144 ts_tablet_manager.cc:1939] T 48462f2d3a8644cf8f58da53102303f1 P dee1f504ab3b4a02a1e465ea780a3b9c: Deleting consensus metadata
I20260807 06:55:59.938566 22146 tablet_replica.cc:330] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: stopping tablet replica
I20260807 06:55:59.938813 22146 raft_consensus.cc:2229] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:59.941124 22143 tablet_replica.cc:330] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: stopping tablet replica
I20260807 06:55:59.941331 22143 raft_consensus.cc:2229] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:55:59.941526 22146 raft_consensus.cc:2258] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:59.941664 22143 raft_consensus.cc:2258] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:55:59.942719 21062 catalog_manager.cc:4841] TS dee1f504ab3b4a02a1e465ea780a3b9c (127.10.191.130:45945): tablet 48462f2d3a8644cf8f58da53102303f1 (table test-table [id=8b6fc051768f42fda5840d0b03c0097c]) successfully deleted
I20260807 06:55:59.942864 22146 ts_tablet_manager.cc:1905] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 06:55:59.943378 21062 catalog_manager.cc:4808] TS dee1f504ab3b4a02a1e465ea780a3b9c (127.10.191.130:45945): delete failed for tablet 48462f2d3a8644cf8f58da53102303f1 because the tablet was not found. No further retry: Not found: Tablet not found: 48462f2d3a8644cf8f58da53102303f1
I20260807 06:55:59.947558 22146 ts_tablet_manager.cc:1918] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:59.947711 22146 log.cc:1196] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/48462f2d3a8644cf8f58da53102303f1
I20260807 06:55:59.948207 22146 ts_tablet_manager.cc:1939] T 48462f2d3a8644cf8f58da53102303f1 P c8646bd931bb404abe5167e704296b3e: Deleting consensus metadata
I20260807 06:55:59.949028 22143 ts_tablet_manager.cc:1905] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:55:59.949342 21063 catalog_manager.cc:4841] TS c8646bd931bb404abe5167e704296b3e (127.10.191.129:33051): tablet 48462f2d3a8644cf8f58da53102303f1 (table test-table [id=8b6fc051768f42fda5840d0b03c0097c]) successfully deleted
I20260807 06:55:59.953459 22143 ts_tablet_manager.cc:1918] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:55:59.953612 22143 log.cc:1196] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/48462f2d3a8644cf8f58da53102303f1
I20260807 06:55:59.955506 22143 ts_tablet_manager.cc:1939] T 48462f2d3a8644cf8f58da53102303f1 P 6d7f9c5340984028adb8636ff0e3faec: Deleting consensus metadata
I20260807 06:55:59.956753 21060 catalog_manager.cc:4841] TS 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405): tablet 48462f2d3a8644cf8f58da53102303f1 (table test-table [id=8b6fc051768f42fda5840d0b03c0097c]) successfully deleted
W20260807 06:55:59.957067 21060 catalog_manager.cc:4808] TS 6d7f9c5340984028adb8636ff0e3faec (127.10.191.131:44405): delete failed for tablet 48462f2d3a8644cf8f58da53102303f1 because the tablet was not found. No further retry: Not found: Tablet not found: 48462f2d3a8644cf8f58da53102303f1
I20260807 06:55:59.959213 22102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:55:59.924059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55424 (local address 127.10.191.129:33051)
0807 06:55:59.924331 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0807 06:55:59.924341 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:55:59.937812 (+ 13471us) server_negotiation.cc:407] Connection header received
0807 06:55:59.938140 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:55:59.938146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:55:59.938246 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:55:59.938370 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:55:59.940700 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.942189 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.949227 (+ 7038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:55:59.949746 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:55:59.949882 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:55:59.952375 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:55:59.952388 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:55:59.952405 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:55:59.952435 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:55:59.955983 (+ 3548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:59.956722 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:59.956732 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:59.956735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:59.956905 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:55:59.957370 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:55:59.957376 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:55:59.957380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:55:59.957895 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:55:59.958211 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0807 06:55:59.958564 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 06:55:59.958832 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:55:59.959854 21605 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:00.054278 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 21305
I20260807 06:56:00.082966 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 21625
I20260807 06:56:00.097539 22105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:00.083852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47198 (local address 127.10.191.130:45945)
0807 06:56:00.084048 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:00.084056 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:00.084144 (+ 88us) server_negotiation.cc:407] Connection header received
0807 06:56:00.084377 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:00.084383 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:00.084476 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:00.084589 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:00.086110 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:00.086905 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:00.088236 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:00.088760 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:00.088907 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:00.091579 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:00.091596 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:00.091615 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:00.091653 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:00.094414 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:00.095173 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:00.095182 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:00.095184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:00.095396 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:00.095832 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:00.095837 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:00.095842 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:00.096249 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:00.096583 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:00.096920 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 06:56:00.097198 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:56:00.098345 21781 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:00.108192 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:00.107768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37910)
0807 06:56:00.107956 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:00.108044 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 06:56:00.109247 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:00.108849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37753 (local address 127.0.0.1:37916)
0807 06:56:00.108994 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:00.109115 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:37753: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 06:56:00.218143 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 21625
I20260807 06:56:00.250326 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 21806
I20260807 06:56:00.263440 22151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:00.251139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36568 (local address 127.10.191.131:44405)
0807 06:56:00.251575 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:00.251579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:00.251594 (+ 15us) server_negotiation.cc:407] Connection header received
0807 06:56:00.251649 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:00.251653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:00.251712 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:00.251798 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:00.253042 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:00.253735 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:00.254955 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:00.255317 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:00.255400 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:00.258054 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:00.258068 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:00.258086 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:00.258129 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:00.260952 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:00.261554 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:00.261567 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:00.261569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:00.261676 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:00.262043 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:00.262046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:00.262048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:00.262382 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:00.262589 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:00.262843 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 06:56:00.263097 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":213,"threads_started":1}
I20260807 06:56:00.264123 21967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:00.352941 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 21806
I20260807 06:56:00.378916 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 20893
I20260807 06:56:00.380126 21119 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:00.499329 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 20893
I20260807 06:56:00.527305 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 21034
I20260807 06:56:00.528520 21394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:00.644657 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 21034
2026-08-07T06:56:00Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10154 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:56:00 dist-test-slave-tfpf krb5kdc[22157](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:56:00 dist-test-slave-tfpf krb5kdc[22157](info): set up 2 sockets
Aug 07 06:56:00 dist-test-slave-tfpf krb5kdc[22157](info): commencing operation
krb5kdc: starting...
W20260807 06:56:01.903625 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.002s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:56:02 dist-test-slave-tfpf krb5kdc[22157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:56:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:56:02Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.190.keytab.
Entry for principal oryx/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.190.keytab.
I20260807 06:56:02.198385 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:43587
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.190.keytab
--principal=oryx/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:43587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:02.544596 22171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:02.544926 22171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:02.545029 22171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:02.552057 22171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:56:02.552173 22171 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 06:56:02.552212 22171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:02.552264 22171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:02.552304 22171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:56:02.552376 22171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:56:02.562382 22171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:43587
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.190.keytab
--principal=oryx/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:43587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:02.563679 22171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:02.565079 22171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:02.577672 22182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:02.577733 22181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:02.577646 22184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:02.578408 22171 server_base.cc:1034] running on GCE node
I20260807 06:56:02.579241 22171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:02.580617 22171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:02.581868 22171 hybrid_clock.cc:648] HybridClock initialized: now 1786085762581804 us; error 45 us; skew 500 ppm
I20260807 06:56:02.582216 22171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:02 dist-test-slave-tfpf krb5kdc[22157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085762, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:02.585676 22171 init.cc:377] Logged in from keytab as oryx/127.10.191.190@KRBTEST.COM (short username oryx)
I20260807 06:56:02.587138 22171 webserver.cc:460] Webserver started at http://127.10.191.190:36779/ using document root <none> and password file <none>
I20260807 06:56:02.587877 22171 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:02.588009 22171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:02.588361 22171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:02.591404 22171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "5b63e8bb858d46c380e055b61627c451"
format_stamp: "Formatted at 2026-08-07 06:56:02 on dist-test-slave-tfpf"
server_key: "27ae244c0fe279ac1c1d618ab9fb25d6"
server_key_iv: "ebcc338e10ecd3f19f7bd68dcf695178"
server_key_version: "encryptionkey@0"
I20260807 06:56:02.592193 22171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "5b63e8bb858d46c380e055b61627c451"
format_stamp: "Formatted at 2026-08-07 06:56:02 on dist-test-slave-tfpf"
server_key: "27ae244c0fe279ac1c1d618ab9fb25d6"
server_key_iv: "ebcc338e10ecd3f19f7bd68dcf695178"
server_key_version: "encryptionkey@0"
I20260807 06:56:02.597702 22171 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 06:56:02.601507 22193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:02.602959 22171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:56:02.603184 22171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "5b63e8bb858d46c380e055b61627c451"
format_stamp: "Formatted at 2026-08-07 06:56:02 on dist-test-slave-tfpf"
server_key: "27ae244c0fe279ac1c1d618ab9fb25d6"
server_key_iv: "ebcc338e10ecd3f19f7bd68dcf695178"
server_key_version: "encryptionkey@0"
I20260807 06:56:02.603432 22171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:02.625236 22171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:02.629308 22171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:02.629593 22171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:02.652313 22171 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:43587
I20260807 06:56:02.652333 22279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:43587 every 8 connection(s)
I20260807 06:56:02.653839 22171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:56:02.658089 22282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:02.658991 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 22171
I20260807 06:56:02.659248 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:56:02.659967 11006 external_mini_cluster.cc:1428] Setting key 0d840e6625c8538636374ba093d10ffc
I20260807 06:56:02.672883 22282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451: Bootstrap starting.
Aug 07 06:56:02 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:56:02.676748 22282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:02.678264 22282 log.cc:824] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:02.681453 22282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451: No bootstrap required, opened a new log
I20260807 06:56:02.684249 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:02.662226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49540 (local address 127.10.191.190:43587)
0807 06:56:02.663160 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:02.663175 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:02.663225 (+ 50us) server_negotiation.cc:407] Connection header received
0807 06:56:02.665114 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:02.665145 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:02.665698 (+ 553us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:02.666192 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:02.667518 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:02.669446 (+ 1928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:02.670607 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:02.671620 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:02.671813 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:02.676067 (+ 4254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:02.676077 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:02.676096 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:02.676140 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:02.679816 (+ 3676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:02.680452 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:02.680459 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:02.680466 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:02.680695 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:02.681019 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:02.681023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:02.681026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:02.681694 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:02.682034 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:02.682345 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 06:56:02.682826 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":397,"threads_started":1}
I20260807 06:56:02.690632 22282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b63e8bb858d46c380e055b61627c451" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43587 } }
I20260807 06:56:02.691030 22282 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:02.691102 22282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b63e8bb858d46c380e055b61627c451, State: Initialized, Role: FOLLOWER
I20260807 06:56:02.691685 22282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b63e8bb858d46c380e055b61627c451" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43587 } }
I20260807 06:56:02.691892 22282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:56:02.691984 22282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:56:02.692101 22282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:02.694607 22282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b63e8bb858d46c380e055b61627c451" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43587 } }
I20260807 06:56:02.695094 22282 leader_election.cc:302] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b63e8bb858d46c380e055b61627c451; no voters:
I20260807 06:56:02.695636 22282 leader_election.cc:288] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:56:02.695796 22291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:02.696547 22291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [term 1 LEADER]: Becoming Leader. State: Replica: 5b63e8bb858d46c380e055b61627c451, State: Running, Role: LEADER
I20260807 06:56:02.697264 22291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b63e8bb858d46c380e055b61627c451" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43587 } }
I20260807 06:56:02.698031 22282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:56:02.700212 22294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b63e8bb858d46c380e055b61627c451. Latest consensus state: current_term: 1 leader_uuid: "5b63e8bb858d46c380e055b61627c451" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b63e8bb858d46c380e055b61627c451" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43587 } } }
I20260807 06:56:02.700222 22293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b63e8bb858d46c380e055b61627c451" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b63e8bb858d46c380e055b61627c451" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 43587 } } }
I20260807 06:56:02.700676 22294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:02.700780 22293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:02.702417 22297 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:56:02.707940 22297 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:56:02.719247 22297 catalog_manager.cc:1347] Generated new cluster ID: 9a1ba0402e6c466486866615a73b6c55
I20260807 06:56:02.719377 22297 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:56:02.753983 22297 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:56:02.755944 22297 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:56:02.770112 22297 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451: Generated new TSK 0
I20260807 06:56:02.771361 22297 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab.
Entry for principal oryx/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab.
I20260807 06:56:02.846686 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:43587
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab
--principal=oryx/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:03.198542 22317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:03.198846 22317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:03.199004 22317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:03.206702 22317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:03.206828 22317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:03.207006 22317 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:56:03.207149 22317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:56:03.217403 22317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab
--principal=oryx/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.191.190:43587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:03.218711 22317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:03.220099 22317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:03.233503 22328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:03.233588 22324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:03.233631 22323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:03.234269 22317 server_base.cc:1034] running on GCE node
I20260807 06:56:03.234992 22317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:03.235927 22317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:03.237191 22317 hybrid_clock.cc:648] HybridClock initialized: now 1786085763237108 us; error 53 us; skew 500 ppm
I20260807 06:56:03.237521 22317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:03 dist-test-slave-tfpf krb5kdc[22157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085763, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:03.245385 22317 init.cc:377] Logged in from keytab as oryx/127.10.191.129@KRBTEST.COM (short username oryx)
I20260807 06:56:03.247100 22317 webserver.cc:460] Webserver started at http://127.10.191.129:40113/ using document root <none> and password file <none>
I20260807 06:56:03.247884 22317 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:03.248028 22317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:03.248438 22317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:03.251716 22317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "04e1f5a75bf04e598d2681e9f746ce4a"
format_stamp: "Formatted at 2026-08-07 06:56:03 on dist-test-slave-tfpf"
server_key: "6810b52c2b778b1e0f31599099176d22"
server_key_iv: "6b41c9c6d731225ddf657d20468fad9e"
server_key_version: "encryptionkey@0"
I20260807 06:56:03.252552 22317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "04e1f5a75bf04e598d2681e9f746ce4a"
format_stamp: "Formatted at 2026-08-07 06:56:03 on dist-test-slave-tfpf"
server_key: "6810b52c2b778b1e0f31599099176d22"
server_key_iv: "6b41c9c6d731225ddf657d20468fad9e"
server_key_version: "encryptionkey@0"
I20260807 06:56:03.258289 22317 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 06:56:03.262017 22335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:03.263420 22317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:56:03.263613 22317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "04e1f5a75bf04e598d2681e9f746ce4a"
format_stamp: "Formatted at 2026-08-07 06:56:03 on dist-test-slave-tfpf"
server_key: "6810b52c2b778b1e0f31599099176d22"
server_key_iv: "6b41c9c6d731225ddf657d20468fad9e"
server_key_version: "encryptionkey@0"
I20260807 06:56:03.263871 22317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:03.279357 22317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:03.283563 22317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:03.283864 22317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:03.287151 22317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:03.287267 22317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:03.287426 22317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:03.287508 22317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:56:03 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085763, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:56:03.310792 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:03.287700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:53865 (local address 127.10.191.190:43587)
0807 06:56:03.288499 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:03.288507 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:03.289589 (+ 1082us) server_negotiation.cc:407] Connection header received
0807 06:56:03.291719 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:03.291724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:03.291828 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:03.291967 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:03.294450 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.295559 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.298376 (+ 2817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.299041 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.299190 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:03.303589 (+ 4399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:03.303598 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:03.303607 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:03.303640 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:03.307075 (+ 3435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:03.307826 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:03.307833 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:03.307837 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:03.307966 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:03.308537 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:03.308562 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:03.308567 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:03.309040 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:03.309254 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:03.310186 (+ 932us) server_negotiation.cc:299] Negotiation successful
0807 06:56:03.310419 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":536,"threads_started":1}
I20260807 06:56:03.311909 22348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:03.288396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43587 (local address 127.10.191.129:53865)
0807 06:56:03.289368 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:03.289426 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:03.291408 (+ 1982us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:03.292240 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:03.292255 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:03.293186 (+ 931us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:03.294151 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:03.294190 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.295727 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.295760 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:03.298207 (+ 2447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:03.298241 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.299317 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.299328 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:03.299575 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:03.300300 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:03.300323 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:03.303271 (+ 2948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:03.307225 (+ 3954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:03.307235 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:03.307255 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:03.307694 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:03.308077 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:03.308081 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:03.308085 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:03.308289 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:03.309277 (+ 988us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:03.309290 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:03.309764 (+ 474us) client_negotiation.cc:769] Sending connection context
0807 06:56:03.310067 (+ 303us) client_negotiation.cc:240] Negotiation successful
0807 06:56:03.310653 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":432,"threads_started":1}
I20260807 06:56:03.334419 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:03.318257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:39873 (local address 127.10.191.190:43587)
0807 06:56:03.318492 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:03.318499 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:03.319307 (+ 808us) server_negotiation.cc:407] Connection header received
0807 06:56:03.319540 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:03.319548 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:03.319671 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:03.319791 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:03.321225 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.321966 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.323895 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.324355 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.324501 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:03.327919 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:03.327927 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:03.327935 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:03.327983 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:03.331475 (+ 3492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:03.332259 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:03.332266 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:03.332270 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:03.332411 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:03.332854 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:03.332862 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:03.332865 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:03.333290 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:03.333484 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:03.333950 (+ 466us) server_negotiation.cc:299] Negotiation successful
0807 06:56:03.334175 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 06:56:03.334923 22416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:03.318274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43587 (local address 127.10.191.129:39873)
0807 06:56:03.319164 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:03.319198 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:03.319376 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:03.319852 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:03.319863 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:03.320501 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:03.321031 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:03.321043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.322151 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.322156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:03.323707 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:03.323732 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.324574 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.324581 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:03.324836 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:03.326349 (+ 1513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:03.326383 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:03.327635 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:03.331622 (+ 3987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:03.331631 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:03.331635 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:03.332111 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:03.332539 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:03.332544 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:03.332548 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:03.332730 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:03.333443 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:03.333448 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:03.333677 (+ 229us) client_negotiation.cc:769] Sending connection context
0807 06:56:03.333866 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 06:56:03.334346 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":538,"threads_started":1}
I20260807 06:56:03.344022 22317 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:39343
I20260807 06:56:03.344086 22492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:39343 every 8 connection(s)
I20260807 06:56:03.345434 22317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:56:03.347549 22493 heartbeater.cc:347] Connected to a master server at 127.10.191.190:43587
I20260807 06:56:03.347800 22493 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:03.348480 22493 heartbeater.cc:511] Master 127.10.191.190:43587 requested a full tablet report, sending...
I20260807 06:56:03.350054 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 22317
I20260807 06:56:03.350324 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:56:03.351151 11006 external_mini_cluster.cc:1428] Setting key 423a9f06015da134251b73bab33d4708
I20260807 06:56:03.351482 22215 ts_manager.cc:194] Registered new tserver with Master: 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129:39343)
I20260807 06:56:03.353271 22215 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:53865
WARNING: no policy specified for oryx/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab.
Entry for principal oryx/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab.
I20260807 06:56:03.413754 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:43587
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab
--principal=oryx/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:03.748462 22501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:03.748781 22501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:03.748922 22501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:03.756628 22501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:03.756804 22501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:03.756973 22501 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:56:03.757139 22501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:56:03.766618 22501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab
--principal=oryx/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.191.190:43587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:03.767999 22501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:03.769558 22501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:03.782480 22508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:03.782522 22510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:03.782668 22507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:03.783233 22501 server_base.cc:1034] running on GCE node
I20260807 06:56:03.783836 22501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:03.784803 22501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:03.786016 22501 hybrid_clock.cc:648] HybridClock initialized: now 1786085763785936 us; error 58 us; skew 500 ppm
I20260807 06:56:03.786321 22501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:03 dist-test-slave-tfpf krb5kdc[22157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085763, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:03.789463 22501 init.cc:377] Logged in from keytab as oryx/127.10.191.130@KRBTEST.COM (short username oryx)
I20260807 06:56:03.790848 22501 webserver.cc:460] Webserver started at http://127.10.191.130:46403/ using document root <none> and password file <none>
I20260807 06:56:03.791548 22501 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:03.791677 22501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:03.792007 22501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:03.794878 22501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "8b76fd5e3302407688783d218b3798d7"
format_stamp: "Formatted at 2026-08-07 06:56:03 on dist-test-slave-tfpf"
server_key: "8f92878b0cd296f2a50538c1edd93387"
server_key_iv: "6d5d103081e9210afd3d7d0ef5b5ae06"
server_key_version: "encryptionkey@0"
I20260807 06:56:03.795682 22501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "8b76fd5e3302407688783d218b3798d7"
format_stamp: "Formatted at 2026-08-07 06:56:03 on dist-test-slave-tfpf"
server_key: "8f92878b0cd296f2a50538c1edd93387"
server_key_iv: "6d5d103081e9210afd3d7d0ef5b5ae06"
server_key_version: "encryptionkey@0"
I20260807 06:56:03.800820 22501 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:56:03.804279 22518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:03.805764 22501 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:56:03.805956 22501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "8b76fd5e3302407688783d218b3798d7"
format_stamp: "Formatted at 2026-08-07 06:56:03 on dist-test-slave-tfpf"
server_key: "8f92878b0cd296f2a50538c1edd93387"
server_key_iv: "6d5d103081e9210afd3d7d0ef5b5ae06"
server_key_version: "encryptionkey@0"
I20260807 06:56:03.806192 22501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:03.823755 22501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:03.827939 22501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:03.828222 22501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:03.831084 22501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:03.831198 22501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:03.831373 22501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:03.831523 22501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 07 06:56:03 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085763, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:56:03.853631 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:03.831605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:59729 (local address 127.10.191.190:43587)
0807 06:56:03.831823 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:03.831830 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:03.833184 (+ 1354us) server_negotiation.cc:407] Connection header received
0807 06:56:03.835311 (+ 2127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:03.835318 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:03.835426 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:03.835535 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:03.837810 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.838787 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.840988 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.841661 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.841774 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:03.845699 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:03.845707 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:03.845714 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:03.845768 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:03.849298 (+ 3530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:03.850319 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:03.850324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:03.850328 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:03.850536 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:03.851286 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:03.851292 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:03.851295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:03.851619 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:03.851814 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:03.853100 (+ 1286us) server_negotiation.cc:299] Negotiation successful
0807 06:56:03.853309 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 06:56:03.855798 22528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:03.832133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43587 (local address 127.10.191.130:59729)
0807 06:56:03.833004 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:03.833049 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:03.834993 (+ 1944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:03.835784 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:03.835793 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:03.836552 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:03.837614 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:03.837640 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.838932 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.838936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:03.840844 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:03.840858 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.841886 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.841892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:03.842125 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:03.842886 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:03.842908 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:03.845407 (+ 2499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:03.849475 (+ 4068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:03.849482 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:03.849495 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:03.850184 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:03.850695 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:03.850702 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:03.850708 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:03.851123 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:03.851776 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:03.851788 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:03.852506 (+ 718us) client_negotiation.cc:769] Sending connection context
0807 06:56:03.852945 (+ 439us) client_negotiation.cc:240] Negotiation successful
0807 06:56:03.853779 (+ 834us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":372,"threads_started":1}
I20260807 06:56:03.887171 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:03.864437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:42821 (local address 127.10.191.190:43587)
0807 06:56:03.864648 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:03.864653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:03.864929 (+ 276us) server_negotiation.cc:407] Connection header received
0807 06:56:03.865259 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:03.865269 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:03.865384 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:03.865469 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:03.867308 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.868314 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.870932 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.871572 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.871692 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:03.877227 (+ 5535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:03.877234 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:03.877239 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:03.877305 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:03.881125 (+ 3820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:03.883843 (+ 2718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:03.883850 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:03.883854 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:03.884041 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:03.884957 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:03.884964 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:03.884968 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:03.885600 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:03.885777 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:03.886477 (+ 700us) server_negotiation.cc:299] Negotiation successful
0807 06:56:03.886750 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:56:03.887370 22614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:03.863884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43587 (local address 127.10.191.130:42821)
0807 06:56:03.864769 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:03.864797 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:03.865002 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:03.865723 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:03.865730 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:03.866538 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:03.867104 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:03.867125 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.868506 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.868514 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:03.870742 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:03.870763 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:03.871993 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:03.872002 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:03.872229 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:03.875725 (+ 3496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:03.875753 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:03.876955 (+ 1202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:03.881300 (+ 4345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:03.881307 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:03.881313 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:03.883535 (+ 2222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:03.884243 (+ 708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:03.884250 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:03.884279 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:03.884427 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:03.885755 (+ 1328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:03.885763 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:03.886018 (+ 255us) client_negotiation.cc:769] Sending connection context
0807 06:56:03.886207 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 06:56:03.886678 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":634,"threads_started":1}
I20260807 06:56:03.896394 22501 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:43829
I20260807 06:56:03.896416 22684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:43829 every 8 connection(s)
I20260807 06:56:03.897904 22501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:56:03.900453 22685 heartbeater.cc:347] Connected to a master server at 127.10.191.190:43587
I20260807 06:56:03.900738 22685 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:03.901456 22685 heartbeater.cc:511] Master 127.10.191.190:43587 requested a full tablet report, sending...
I20260807 06:56:03.902844 22215 ts_manager.cc:194] Registered new tserver with Master: 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829)
I20260807 06:56:03.903654 22215 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:59729
I20260807 06:56:03.904592 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 22501
I20260807 06:56:03.904783 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:56:03.905390 11006 external_mini_cluster.cc:1428] Setting key a5b8ada126f8bcd88f2f12ebc7f319ad
WARNING: no policy specified for oryx/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab.
Entry for principal oryx/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab.
I20260807 06:56:03.966449 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:43587
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab
--principal=oryx/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:04.302644 22689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:04.302939 22689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:04.303092 22689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:04.310456 22689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:04.310654 22689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:04.310817 22689 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 06:56:04.310941 22689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:56:04.320673 22689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab
--principal=oryx/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.191.190:43587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:04.322181 22689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:04.323587 22689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:04.336829 22695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:04.336917 22696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:04.336906 22699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:04.337853 22689 server_base.cc:1034] running on GCE node
I20260807 06:56:04.338459 22689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:04.339344 22689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:04.340562 22689 hybrid_clock.cc:648] HybridClock initialized: now 1786085764340476 us; error 52 us; skew 500 ppm
I20260807 06:56:04.340858 22689 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:04 dist-test-slave-tfpf krb5kdc[22157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085764, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:04.343838 22689 init.cc:377] Logged in from keytab as oryx/127.10.191.131@KRBTEST.COM (short username oryx)
I20260807 06:56:04.348325 22689 webserver.cc:460] Webserver started at http://127.10.191.131:40751/ using document root <none> and password file <none>
I20260807 06:56:04.349042 22689 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:04.349213 22689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:04.349563 22689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:04.352470 22689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "c821700deda54bf3b0a0406055600c41"
format_stamp: "Formatted at 2026-08-07 06:56:04 on dist-test-slave-tfpf"
server_key: "c66312c999000523d96a3513c9bf6c40"
server_key_iv: "0e1d1e584761f51f76c5c695d7bbe942"
server_key_version: "encryptionkey@0"
I20260807 06:56:04.353327 22689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "c821700deda54bf3b0a0406055600c41"
format_stamp: "Formatted at 2026-08-07 06:56:04 on dist-test-slave-tfpf"
server_key: "c66312c999000523d96a3513c9bf6c40"
server_key_iv: "0e1d1e584761f51f76c5c695d7bbe942"
server_key_version: "encryptionkey@0"
I20260807 06:56:04.356918 22493 heartbeater.cc:503] Master 127.10.191.190:43587 was elected leader, sending a full tablet report...
I20260807 06:56:04.359156 22689 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:56:04.362744 22710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:04.363981 22689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:56:04.364179 22689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "c821700deda54bf3b0a0406055600c41"
format_stamp: "Formatted at 2026-08-07 06:56:04 on dist-test-slave-tfpf"
server_key: "c66312c999000523d96a3513c9bf6c40"
server_key_iv: "0e1d1e584761f51f76c5c695d7bbe942"
server_key_version: "encryptionkey@0"
I20260807 06:56:04.364456 22689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:04.381388 22689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:04.385283 22689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:04.385572 22689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:04.388392 22689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:04.388500 22689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:04.388659 22689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:04.388752 22689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 06:56:04 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085764, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:56:04.415692 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.388955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:34801 (local address 127.10.191.190:43587)
0807 06:56:04.391489 (+ 2534us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.391495 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.391520 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:56:04.393444 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.393450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.393544 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.393681 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:04.396984 (+ 3303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.398031 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.400570 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.401316 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.401471 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.406919 (+ 5448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:04.406928 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:04.406936 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:04.406995 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:04.411223 (+ 4228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:04.412331 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:04.412335 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:04.412337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:04.412464 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:04.412977 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:04.412982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:04.412985 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:04.413371 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:04.413550 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.414900 (+ 1350us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.415187 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2373,"thread_start_us":2268,"threads_started":1}
I20260807 06:56:04.417495 22722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.389643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43587 (local address 127.10.191.131:34801)
0807 06:56:04.390734 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:04.390797 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:04.393123 (+ 2326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:04.394148 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:04.394165 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:04.395519 (+ 1354us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:04.396689 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.396736 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.398268 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.398279 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.400374 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.400414 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.401635 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.401647 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.401888 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.402783 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:04.402827 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:04.406602 (+ 3775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:04.411434 (+ 4832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:04.411444 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:04.411463 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:04.412174 (+ 711us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:04.412598 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:04.412602 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:04.412606 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:04.412833 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:04.413565 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:04.413575 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:04.414277 (+ 702us) client_negotiation.cc:769] Sending connection context
0807 06:56:04.414720 (+ 443us) client_negotiation.cc:240] Negotiation successful
0807 06:56:04.415534 (+ 814us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":409,"threads_started":1}
I20260807 06:56:04.430310 22689 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:39485
I20260807 06:56:04.430338 22859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:39485 every 8 connection(s)
I20260807 06:56:04.431810 22689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:56:04.434278 22860 heartbeater.cc:347] Connected to a master server at 127.10.191.190:43587
I20260807 06:56:04.434531 22860 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:04.435226 22860 heartbeater.cc:511] Master 127.10.191.190:43587 requested a full tablet report, sending...
I20260807 06:56:04.436872 22215 ts_manager.cc:194] Registered new tserver with Master: c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485)
I20260807 06:56:04.437122 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 22689
I20260807 06:56:04.437316 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:56:04.437830 11006 external_mini_cluster.cc:1428] Setting key ec4938e3b32a2f09f3401f39e395466a
I20260807 06:56:04.438180 22215 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:34801
I20260807 06:56:04.438822 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.424805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:40507 (local address 127.10.191.190:43587)
0807 06:56:04.424961 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.424965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.425593 (+ 628us) server_negotiation.cc:407] Connection header received
0807 06:56:04.425778 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.425782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.425875 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.425970 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:04.427205 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.428216 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.429663 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.430194 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.430309 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.432251 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:04.432256 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:04.432258 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:04.432289 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:04.435671 (+ 3382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:04.436501 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:04.436506 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:04.436508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:04.436687 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:04.437183 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:04.437187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:04.437190 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:04.437619 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:04.437776 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.438271 (+ 495us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.438493 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":40}
I20260807 06:56:04.438854 22848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.424808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43587 (local address 127.10.191.131:40507)
0807 06:56:04.425481 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:04.425495 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:04.425650 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:04.426166 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:04.426170 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:04.426775 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:04.427053 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.427063 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.428337 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.428342 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.429531 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.429549 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.430391 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.430398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.430580 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.431231 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:04.431248 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:04.432049 (+ 801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:04.435804 (+ 3755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:04.435810 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:04.435819 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:04.436378 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:04.436859 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:04.436867 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:04.436872 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:04.437032 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:04.437756 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:04.437760 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:04.437973 (+ 213us) client_negotiation.cc:769] Sending connection context
0807 06:56:04.438126 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 06:56:04.438450 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":407,"threads_started":1}
I20260807 06:56:04.441336 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 06:56:04 dist-test-slave-tfpf krb5kdc[22157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085764, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 06:56:04 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:04 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 06:56:04.506834 22721 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:04.495714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49544 (local address 127.10.191.190:43587)
0807 06:56:04.496038 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.496047 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.496228 (+ 181us) server_negotiation.cc:407] Connection header received
0807 06:56:04.496398 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.496402 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.496475 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.496592 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:04.498121 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.498865 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.500163 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.500600 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.500751 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.506580 (+ 5829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49544: BlockingRecv error: recv got EOF from 127.0.0.1:49544 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 07 06:56:04 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085764, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:56:04.523742 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.510132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49548 (local address 127.10.191.190:43587)
0807 06:56:04.510298 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.510302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.510675 (+ 373us) server_negotiation.cc:407] Connection header received
0807 06:56:04.510841 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.510848 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.510935 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.511036 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:04.512070 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.512698 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.514056 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.514625 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.514753 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.518698 (+ 3945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:04.518703 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:04.518706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:04.518744 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:04.521423 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:04.522102 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:04.522106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:04.522109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:04.522240 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:04.522584 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:04.522587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:04.522589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:04.522850 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:04.523052 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.523318 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.523496 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:56:04.528401 22215 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:56:04.536257 22215 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:56:04.561601 22886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.548670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39485 (local address 127.0.0.1:38878)
0807 06:56:04.549568 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:04.549631 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:04.549814 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:04.551210 (+ 1396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:04.551222 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:04.551263 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:04.551820 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.551837 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.554690 (+ 2853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.554699 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.557700 (+ 3001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.557722 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.560254 (+ 2532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.560264 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.560609 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.560701 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 06:56:04.560836 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 06:56:04.561108 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":467,"threads_started":1}
I20260807 06:56:04.563405 22887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.548997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38878 (local address 127.10.191.131:39485)
0807 06:56:04.550482 (+ 1485us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.550490 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.550520 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:56:04.550626 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.550634 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.550938 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.552055 (+ 1117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:04.552429 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.554487 (+ 2058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.557967 (+ 3480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.559956 (+ 1989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.562461 (+ 2505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.562716 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.562795 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.563003 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1315,"thread_start_us":1144,"threads_started":1}
I20260807 06:56:04.569519 22769 tablet_service.cc:1467] Processing CreateTablet for tablet ea5289c13e2446a5af6eb062f0dece00 (DEFAULT_TABLE table=test-table [id=a3fdb9764c004ac1aa3d5ad6f86f118a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:04.571184 22769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea5289c13e2446a5af6eb062f0dece00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:04.571491 22886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.549515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:43829 (local address 127.0.0.1:41520)
0807 06:56:04.561939 (+ 12424us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:04.561963 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:04.562094 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:04.564575 (+ 2481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:04.564583 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:04.564624 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:04.564904 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.564922 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.567314 (+ 2392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.567320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.568964 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.568980 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.570735 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.570740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.570893 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.570940 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 06:56:04.571071 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 06:56:04.571222 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12296,"thread_start_us":15120,"threads_started":1}
I20260807 06:56:04.571528 22889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.549847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41520 (local address 127.10.191.130:43829)
0807 06:56:04.563638 (+ 13791us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.563651 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.563691 (+ 40us) server_negotiation.cc:407] Connection header received
0807 06:56:04.563830 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.563842 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.564237 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.565164 (+ 927us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:04.565420 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.567143 (+ 1723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.569143 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.570533 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.570757 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.570914 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.571086 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.571248 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13573,"thread_start_us":14372,"threads_started":1}
I20260807 06:56:04.573717 22888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.549896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:39343 (local address 127.0.0.1:40140)
0807 06:56:04.564938 (+ 15042us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:04.564973 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:04.565243 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:04.565808 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:04.565812 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:04.565836 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:04.566263 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.566273 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.568147 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.568153 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.570504 (+ 2351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.570518 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.572909 (+ 2391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.572917 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.573049 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.573135 (+ 86us) client_negotiation.cc:769] Sending connection context
0807 06:56:04.573248 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 06:56:04.573383 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14887,"thread_start_us":15106,"threads_started":1}
I20260807 06:56:04.573781 22892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.550569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40140 (local address 127.10.191.129:39343)
0807 06:56:04.564136 (+ 13567us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.564148 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.565123 (+ 975us) server_negotiation.cc:407] Connection header received
0807 06:56:04.565442 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.565448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.565630 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.565818 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:04.566470 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.568012 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.570663 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.572337 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.572514 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.572686 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.573306 (+ 620us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.573481 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13384,"thread_start_us":13256,"threads_started":1}
I20260807 06:56:04.575736 22591 tablet_service.cc:1467] Processing CreateTablet for tablet ea5289c13e2446a5af6eb062f0dece00 (DEFAULT_TABLE table=test-table [id=a3fdb9764c004ac1aa3d5ad6f86f118a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:04.577262 22591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea5289c13e2446a5af6eb062f0dece00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:04.577515 22399 tablet_service.cc:1467] Processing CreateTablet for tablet ea5289c13e2446a5af6eb062f0dece00 (DEFAULT_TABLE table=test-table [id=a3fdb9764c004ac1aa3d5ad6f86f118a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:04.578992 22399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea5289c13e2446a5af6eb062f0dece00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:04.585765 22893 tablet_bootstrap.cc:492] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: Bootstrap starting.
I20260807 06:56:04.589448 22893 tablet_bootstrap.cc:654] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:04.590629 22893 log.cc:824] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:04.593398 22893 tablet_bootstrap.cc:492] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: No bootstrap required, opened a new log
I20260807 06:56:04.593674 22896 tablet_bootstrap.cc:492] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: Bootstrap starting.
I20260807 06:56:04.593909 22893 ts_tablet_manager.cc:1397] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.003s
I20260807 06:56:04.597453 22896 tablet_bootstrap.cc:654] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:04.598012 22895 tablet_bootstrap.cc:492] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: Bootstrap starting.
I20260807 06:56:04.599385 22896 log.cc:824] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:04.601948 22895 tablet_bootstrap.cc:654] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:04.603052 22895 log.cc:824] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:04.603121 22896 tablet_bootstrap.cc:492] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: No bootstrap required, opened a new log
I20260807 06:56:04.603432 22896 ts_tablet_manager.cc:1397] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 06:56:04.604974 22893 raft_consensus.cc:348] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } }
I20260807 06:56:04.605544 22893 raft_consensus.cc:374] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:04.605692 22893 raft_consensus.cc:729] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c821700deda54bf3b0a0406055600c41, State: Initialized, Role: FOLLOWER
I20260807 06:56:04.606263 22895 tablet_bootstrap.cc:492] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: No bootstrap required, opened a new log
I20260807 06:56:04.606521 22895 ts_tablet_manager.cc:1397] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 06:56:04.606339 22893 consensus_queue.cc:260] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } }
I20260807 06:56:04.615070 22895 raft_consensus.cc:348] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } }
I20260807 06:56:04.615507 22895 raft_consensus.cc:374] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:04.615630 22895 raft_consensus.cc:729] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e1f5a75bf04e598d2681e9f746ce4a, State: Initialized, Role: FOLLOWER
I20260807 06:56:04.616289 22895 consensus_queue.cc:260] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } }
I20260807 06:56:04.617328 22896 raft_consensus.cc:348] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } }
I20260807 06:56:04.617883 22896 raft_consensus.cc:374] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:04.618029 22896 raft_consensus.cc:729] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b76fd5e3302407688783d218b3798d7, State: Initialized, Role: FOLLOWER
I20260807 06:56:04.618808 22896 consensus_queue.cc:260] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } }
I20260807 06:56:04.619715 22895 ts_tablet_manager.cc:1428] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260807 06:56:04.619961 22860 heartbeater.cc:503] Master 127.10.191.190:43587 was elected leader, sending a full tablet report...
I20260807 06:56:04.620639 22893 ts_tablet_manager.cc:1428] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: Time spent starting tablet: real 0.027s user 0.013s sys 0.012s
I20260807 06:56:04.621872 22685 heartbeater.cc:503] Master 127.10.191.190:43587 was elected leader, sending a full tablet report...
I20260807 06:56:04.622473 22896 ts_tablet_manager.cc:1428] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: Time spent starting tablet: real 0.019s user 0.012s sys 0.004s
W20260807 06:56:04.650202 22686 tablet.cc:2369] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:56:04.654662 22901 raft_consensus.cc:482] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:56:04.655010 22901 raft_consensus.cc:504] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } }
I20260807 06:56:04.656872 22901 leader_election.cc:288] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485), 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829)
I20260807 06:56:04.664742 22889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.657593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:49837 (local address 127.10.191.130:43829)
0807 06:56:04.657787 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.657792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.658983 (+ 1191us) server_negotiation.cc:407] Connection header received
0807 06:56:04.659125 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.659130 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.659209 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.659304 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:04.659997 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.660920 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.662816 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.663742 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.663898 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.663974 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.664326 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.664459 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:56:04.664834 22906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.657242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:43829 (local address 127.10.191.129:49837)
0807 06:56:04.658832 (+ 1590us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:04.658850 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:04.658972 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:04.659393 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:04.659398 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:04.659426 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:04.659846 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.659856 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.661050 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.661055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.662648 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.662660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.663967 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.663973 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.664125 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.664157 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 06:56:04.664277 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 06:56:04.664402 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1422,"mutex_wait_us":580,"thread_start_us":629,"threads_started":1}
I20260807 06:56:04.665623 22887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.657535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:46459 (local address 127.10.191.131:39485)
0807 06:56:04.657787 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.657795 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.658610 (+ 815us) server_negotiation.cc:407] Connection header received
0807 06:56:04.658927 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.658933 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.659027 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.659131 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:04.659776 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.660747 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.663398 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.664433 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.664587 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.664657 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.665245 (+ 588us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.665382 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 06:56:04.665730 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.657242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39485 (local address 127.10.191.129:46459)
0807 06:56:04.658472 (+ 1230us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:04.658497 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:04.658744 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:04.659156 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:04.659161 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:04.659195 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:04.659634 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.659645 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.660897 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.660902 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.663238 (+ 2336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.663252 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.664856 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.664866 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.665041 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.665106 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 06:56:04.665198 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 06:56:04.665334 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"mutex_wait_us":47,"thread_start_us":791,"threads_started":1}
I20260807 06:56:04.666304 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea5289c13e2446a5af6eb062f0dece00" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7" is_pre_election: true
I20260807 06:56:04.666908 22621 raft_consensus.cc:2454] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 0.
I20260807 06:56:04.666858 22794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea5289c13e2446a5af6eb062f0dece00" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c821700deda54bf3b0a0406055600c41" is_pre_election: true
I20260807 06:56:04.667413 22794 raft_consensus.cc:2454] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 0.
I20260807 06:56:04.667652 22337 leader_election.cc:302] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e1f5a75bf04e598d2681e9f746ce4a, 8b76fd5e3302407688783d218b3798d7; no voters:
I20260807 06:56:04.668057 22901 raft_consensus.cc:2781] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:56:04.668205 22901 raft_consensus.cc:482] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:56:04.668303 22901 raft_consensus.cc:3037] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:04.670780 22901 raft_consensus.cc:504] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } }
I20260807 06:56:04.671456 22901 leader_election.cc:288] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 election: Requested vote from peers c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485), 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829)
I20260807 06:56:04.671955 22794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea5289c13e2446a5af6eb062f0dece00" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c821700deda54bf3b0a0406055600c41"
I20260807 06:56:04.671955 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea5289c13e2446a5af6eb062f0dece00" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7"
I20260807 06:56:04.672174 22794 raft_consensus.cc:3037] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:04.672174 22621 raft_consensus.cc:3037] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:04.675406 22621 raft_consensus.cc:2454] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 1.
I20260807 06:56:04.675407 22794 raft_consensus.cc:2454] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 1.
I20260807 06:56:04.675832 22336 leader_election.cc:302] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e1f5a75bf04e598d2681e9f746ce4a, c821700deda54bf3b0a0406055600c41; no voters:
I20260807 06:56:04.676163 22901 raft_consensus.cc:2781] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:04.676641 22901 raft_consensus.cc:686] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 LEADER]: Becoming Leader. State: Replica: 04e1f5a75bf04e598d2681e9f746ce4a, State: Running, Role: LEADER
I20260807 06:56:04.677198 22901 consensus_queue.cc:237] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } }
I20260807 06:56:04.682366 22212 catalog_manager.cc:5495] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129). New cstate: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } health_report { overall_health: HEALTHY } } }
W20260807 06:56:04.683768 22861 tablet.cc:2369] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:56:04.715694 22892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.710466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40156 (local address 127.10.191.129:39343)
0807 06:56:04.710717 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.710722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.710742 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:56:04.710942 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.710946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.711082 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.711220 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:56:04.711533 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.712180 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.713385 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.713849 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.713942 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.714402 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:56:04.715000 (+ 598us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:56:04.715122 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.715317 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.715383 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 06:56:04.724223 22621 raft_consensus.cc:1261] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Refusing update from remote peer 04e1f5a75bf04e598d2681e9f746ce4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:04.724225 22794 raft_consensus.cc:1261] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Refusing update from remote peer 04e1f5a75bf04e598d2681e9f746ce4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:04.725301 22908 consensus_queue.cc:1035] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:04.725697 22901 consensus_queue.cc:1035] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:04.738088 22913 mvcc.cc:205] Tried to move back new op lower bound from 7315807292300320768 to 7315807292121726976. Current Snapshot: MvccSnapshot[applied={T|T < 7315807292300320768}]
I20260807 06:56:04.743270 22915 mvcc.cc:205] Tried to move back new op lower bound from 7315807292300320768 to 7315807292121726976. Current Snapshot: MvccSnapshot[applied={T|T < 7315807292300320768}]
I20260807 06:56:04.755682 22214 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:04.756062 22214 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:04.759934 22214 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451: Sending DeleteTablet for 3 replicas of tablet ea5289c13e2446a5af6eb062f0dece00
I20260807 06:56:04.761251 22591 tablet_service.cc:1514] Processing DeleteTablet for tablet ea5289c13e2446a5af6eb062f0dece00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:04 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:41520
I20260807 06:56:04.761251 22769 tablet_service.cc:1514] Processing DeleteTablet for tablet ea5289c13e2446a5af6eb062f0dece00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:04 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:38878
I20260807 06:56:04.761308 22399 tablet_service.cc:1514] Processing DeleteTablet for tablet ea5289c13e2446a5af6eb062f0dece00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:04 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:40140
I20260807 06:56:04.763655 22212 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:56:04.764477 22212 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:56:04.773983 22928 tablet_replica.cc:330] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: stopping tablet replica
I20260807 06:56:04.774670 22928 raft_consensus.cc:2229] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:56:04.774801 22590 tablet_service.cc:1467] Processing CreateTablet for tablet c376cd2a1a76460d81c7f9740c4b6e1a (DEFAULT_TABLE table=test-table [id=ca9f03817caa4b409052dbe57665d902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:04.775492 22590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c376cd2a1a76460d81c7f9740c4b6e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:04.775552 22928 raft_consensus.cc:2258] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:04.776575 22925 tablet_replica.cc:330] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: stopping tablet replica
I20260807 06:56:04.777592 22925 raft_consensus.cc:2229] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:04.778234 22925 raft_consensus.cc:2258] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:04.778609 22768 tablet_service.cc:1467] Processing CreateTablet for tablet c376cd2a1a76460d81c7f9740c4b6e1a (DEFAULT_TABLE table=test-table [id=ca9f03817caa4b409052dbe57665d902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:04.779268 22768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c376cd2a1a76460d81c7f9740c4b6e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:04.779982 22926 tablet_replica.cc:330] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: stopping tablet replica
I20260807 06:56:04.780579 22926 raft_consensus.cc:2229] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:04.781095 22926 raft_consensus.cc:2258] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:04.781369 22925 ts_tablet_manager.cc:1905] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:04.783246 22926 ts_tablet_manager.cc:1905] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:04.786036 22398 tablet_service.cc:1467] Processing CreateTablet for tablet c376cd2a1a76460d81c7f9740c4b6e1a (DEFAULT_TABLE table=test-table [id=ca9f03817caa4b409052dbe57665d902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:04.786568 22398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c376cd2a1a76460d81c7f9740c4b6e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:04.788933 22925 ts_tablet_manager.cc:1918] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:56:04.789119 22925 log.cc:1196] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/ea5289c13e2446a5af6eb062f0dece00
I20260807 06:56:04.790297 22926 ts_tablet_manager.cc:1918] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:56:04.790546 22926 log.cc:1196] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/ea5289c13e2446a5af6eb062f0dece00
I20260807 06:56:04.790766 22928 ts_tablet_manager.cc:1905] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:04.791142 22926 ts_tablet_manager.cc:1939] T ea5289c13e2446a5af6eb062f0dece00 P c821700deda54bf3b0a0406055600c41: Deleting consensus metadata
I20260807 06:56:04.793218 22194 catalog_manager.cc:4841] TS c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485): tablet ea5289c13e2446a5af6eb062f0dece00 (table test-table [id=a3fdb9764c004ac1aa3d5ad6f86f118a]) successfully deleted
I20260807 06:56:04.797998 22893 tablet_bootstrap.cc:492] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: Bootstrap starting.
I20260807 06:56:04.798660 22925 ts_tablet_manager.cc:1939] T ea5289c13e2446a5af6eb062f0dece00 P 8b76fd5e3302407688783d218b3798d7: Deleting consensus metadata
I20260807 06:56:04.799690 22893 tablet_bootstrap.cc:654] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:04.800417 22928 ts_tablet_manager.cc:1918] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:56:04.800591 22928 log.cc:1196] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/ea5289c13e2446a5af6eb062f0dece00
I20260807 06:56:04.800993 22895 tablet_bootstrap.cc:492] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: Bootstrap starting.
I20260807 06:56:04.801733 22196 catalog_manager.cc:4841] TS 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829): tablet ea5289c13e2446a5af6eb062f0dece00 (table test-table [id=a3fdb9764c004ac1aa3d5ad6f86f118a]) successfully deleted
I20260807 06:56:04.802218 22928 ts_tablet_manager.cc:1939] T ea5289c13e2446a5af6eb062f0dece00 P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting consensus metadata
I20260807 06:56:04.802753 22895 tablet_bootstrap.cc:654] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:04.804229 22194 catalog_manager.cc:4841] TS 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129:39343): tablet ea5289c13e2446a5af6eb062f0dece00 (table test-table [id=a3fdb9764c004ac1aa3d5ad6f86f118a]) successfully deleted
I20260807 06:56:04.805706 22896 tablet_bootstrap.cc:492] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: Bootstrap starting.
I20260807 06:56:04.807988 22896 tablet_bootstrap.cc:654] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:04.814038 22896 tablet_bootstrap.cc:492] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: No bootstrap required, opened a new log
I20260807 06:56:04.814038 22893 tablet_bootstrap.cc:492] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: No bootstrap required, opened a new log
I20260807 06:56:04.814241 22893 ts_tablet_manager.cc:1397] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.009s
I20260807 06:56:04.814342 22896 ts_tablet_manager.cc:1397] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260807 06:56:04.815562 22896 raft_consensus.cc:348] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:04.816032 22896 raft_consensus.cc:374] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:04.816191 22896 raft_consensus.cc:729] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b76fd5e3302407688783d218b3798d7, State: Initialized, Role: FOLLOWER
I20260807 06:56:04.816603 22893 raft_consensus.cc:348] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:04.816642 22896 consensus_queue.cc:260] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:04.816972 22893 raft_consensus.cc:374] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:04.817149 22893 raft_consensus.cc:729] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c821700deda54bf3b0a0406055600c41, State: Initialized, Role: FOLLOWER
I20260807 06:56:04.817507 22893 consensus_queue.cc:260] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:04.819583 22893 ts_tablet_manager.cc:1428] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260807 06:56:04.821550 22896 ts_tablet_manager.cc:1428] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260807 06:56:04.825608 22895 tablet_bootstrap.cc:492] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: No bootstrap required, opened a new log
I20260807 06:56:04.825851 22895 ts_tablet_manager.cc:1397] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.012s
I20260807 06:56:04.826778 22895 raft_consensus.cc:348] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:04.827067 22895 raft_consensus.cc:374] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:04.827255 22895 raft_consensus.cc:729] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e1f5a75bf04e598d2681e9f746ce4a, State: Initialized, Role: FOLLOWER
I20260807 06:56:04.827617 22895 consensus_queue.cc:260] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:04.828269 22895 ts_tablet_manager.cc:1428] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260807 06:56:04.847922 22495 tablet.cc:2369] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:56:04.905282 22920 raft_consensus.cc:482] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:56:04.905582 22920 raft_consensus.cc:504] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:04.906534 22920 leader_election.cc:288] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829), c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485)
I20260807 06:56:04.907145 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376cd2a1a76460d81c7f9740c4b6e1a" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7" is_pre_election: true
I20260807 06:56:04.907411 22621 raft_consensus.cc:2454] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 0.
I20260807 06:56:04.907451 22794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376cd2a1a76460d81c7f9740c4b6e1a" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c821700deda54bf3b0a0406055600c41" is_pre_election: true
I20260807 06:56:04.907728 22794 raft_consensus.cc:2454] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 0.
I20260807 06:56:04.907950 22337 leader_election.cc:302] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e1f5a75bf04e598d2681e9f746ce4a, 8b76fd5e3302407688783d218b3798d7; no voters:
I20260807 06:56:04.908320 22920 raft_consensus.cc:2781] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:56:04.908457 22920 raft_consensus.cc:482] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:56:04.908565 22920 raft_consensus.cc:3037] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:04.911963 22920 raft_consensus.cc:504] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:04.913241 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376cd2a1a76460d81c7f9740c4b6e1a" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7"
I20260807 06:56:04.913486 22621 raft_consensus.cc:3037] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:04.913383 22794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c376cd2a1a76460d81c7f9740c4b6e1a" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c821700deda54bf3b0a0406055600c41"
I20260807 06:56:04.913658 22794 raft_consensus.cc:3037] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:04.916566 22621 raft_consensus.cc:2454] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 1.
I20260807 06:56:04.916733 22794 raft_consensus.cc:2454] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 1.
I20260807 06:56:04.917050 22920 leader_election.cc:288] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 election: Requested vote from peers 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829), c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485)
I20260807 06:56:04.917241 22336 leader_election.cc:302] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e1f5a75bf04e598d2681e9f746ce4a, c821700deda54bf3b0a0406055600c41; no voters:
I20260807 06:56:04.917567 22920 raft_consensus.cc:2781] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:04.917788 22920 raft_consensus.cc:686] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 LEADER]: Becoming Leader. State: Replica: 04e1f5a75bf04e598d2681e9f746ce4a, State: Running, Role: LEADER
I20260807 06:56:04.918162 22920 consensus_queue.cc:237] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:04.921355 22215 catalog_manager.cc:5495] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129). New cstate: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } health_report { overall_health: UNKNOWN } } }
Aug 07 06:56:04 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085762, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.190@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:56:04.981220 22942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.964056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:43587 (local address 127.0.0.1:49550)
0807 06:56:04.964841 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:04.964861 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:04.965008 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:04.965451 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:04.965455 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:04.966459 (+ 1004us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:04.966841 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.966858 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.968478 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.968485 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.969965 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:04.969981 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.971091 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.971100 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:04.971383 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.972315 (+ 932us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:04.972334 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:04.975101 (+ 2767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:04.978285 (+ 3184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:04.978300 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:04.978308 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:04.978741 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:04.979136 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:04.979141 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:04.979145 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:04.979361 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:04.979926 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:04.979951 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:04.980174 (+ 223us) client_negotiation.cc:769] Sending connection context
0807 06:56:04.980358 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 06:56:04.980699 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":443,"threads_started":1}
I20260807 06:56:04.981244 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:04.964051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49550 (local address 127.10.191.190:43587)
0807 06:56:04.964334 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:04.964340 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:04.964968 (+ 628us) server_negotiation.cc:407] Connection header received
0807 06:56:04.965181 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:04.965188 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:04.965272 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:04.965385 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:04.967076 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.968304 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.970164 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:04.970848 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:04.970987 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:04.975303 (+ 4316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:04.975310 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:04.975314 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:04.975354 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:04.978147 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:04.978870 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:04.978875 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:04.978878 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:04.979002 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:04.979483 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:04.979487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:04.979491 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:04.979779 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:04.979961 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:04.980477 (+ 516us) server_negotiation.cc:299] Negotiation successful
0807 06:56:04.980853 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":146,"server-negotiator.queue_time_us":135}
I20260807 06:56:04.987430 22215 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:49550:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 06:56:04.988518 22215 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:56:04.996279 22768 tablet_service.cc:1467] Processing CreateTablet for tablet 174e8c3223f546ac8327dfe7bdfae476 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5ec39d537b524f76acd4983bbdc45022]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:56:04.996253 22398 tablet_service.cc:1467] Processing CreateTablet for tablet 174e8c3223f546ac8327dfe7bdfae476 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5ec39d537b524f76acd4983bbdc45022]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:56:04.996914 22768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 174e8c3223f546ac8327dfe7bdfae476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:04.996934 22398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 174e8c3223f546ac8327dfe7bdfae476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:04.998107 22590 tablet_service.cc:1467] Processing CreateTablet for tablet 174e8c3223f546ac8327dfe7bdfae476 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5ec39d537b524f76acd4983bbdc45022]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 06:56:04.998654 22590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 174e8c3223f546ac8327dfe7bdfae476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:05.002924 22893 tablet_bootstrap.cc:492] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: Bootstrap starting.
I20260807 06:56:05.004397 22893 tablet_bootstrap.cc:654] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:05.011837 22896 tablet_bootstrap.cc:492] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: Bootstrap starting.
I20260807 06:56:05.014356 22896 tablet_bootstrap.cc:654] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:05.014470 22895 tablet_bootstrap.cc:492] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: Bootstrap starting.
I20260807 06:56:05.016407 22895 tablet_bootstrap.cc:654] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:05.022377 22896 tablet_bootstrap.cc:492] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: No bootstrap required, opened a new log
I20260807 06:56:05.022743 22896 ts_tablet_manager.cc:1397] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20260807 06:56:05.023860 22896 raft_consensus.cc:348] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.024346 22896 raft_consensus.cc:374] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:05.024497 22896 raft_consensus.cc:729] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b76fd5e3302407688783d218b3798d7, State: Initialized, Role: FOLLOWER
I20260807 06:56:05.024942 22896 consensus_queue.cc:260] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.025650 22895 tablet_bootstrap.cc:492] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: No bootstrap required, opened a new log
I20260807 06:56:05.025895 22895 ts_tablet_manager.cc:1397] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260807 06:56:05.025673 22903 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.026139 22903 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:56:05.026714 22895 raft_consensus.cc:348] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.026938 22895 raft_consensus.cc:374] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:05.027014 22895 raft_consensus.cc:729] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e1f5a75bf04e598d2681e9f746ce4a, State: Initialized, Role: FOLLOWER
I20260807 06:56:05.027288 22895 consensus_queue.cc:260] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.027695 22920 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.027971 22920 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:56:05.030715 22895 ts_tablet_manager.cc:1428] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260807 06:56:05.031332 22896 ts_tablet_manager.cc:1428] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260807 06:56:05.034861 22893 tablet_bootstrap.cc:492] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: No bootstrap required, opened a new log
I20260807 06:56:05.035108 22893 ts_tablet_manager.cc:1397] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.027s
I20260807 06:56:05.035838 22893 raft_consensus.cc:348] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.036089 22893 raft_consensus.cc:374] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:05.036180 22893 raft_consensus.cc:729] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c821700deda54bf3b0a0406055600c41, State: Initialized, Role: FOLLOWER
I20260807 06:56:05.036425 22893 consensus_queue.cc:260] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.037109 22893 ts_tablet_manager.cc:1428] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 06:56:05.036975 22900 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.037380 22900 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:56:05.283748 22920 raft_consensus.cc:482] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:56:05.284001 22920 raft_consensus.cc:504] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.284641 22920 leader_election.cc:288] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829), c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485)
I20260807 06:56:05.285331 22794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174e8c3223f546ac8327dfe7bdfae476" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c821700deda54bf3b0a0406055600c41" is_pre_election: true
I20260807 06:56:05.285357 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174e8c3223f546ac8327dfe7bdfae476" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7" is_pre_election: true
I20260807 06:56:05.285626 22794 raft_consensus.cc:2454] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 0.
I20260807 06:56:05.285661 22621 raft_consensus.cc:2454] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 0.
I20260807 06:56:05.286155 22336 leader_election.cc:302] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 04e1f5a75bf04e598d2681e9f746ce4a, 8b76fd5e3302407688783d218b3798d7, c821700deda54bf3b0a0406055600c41; no voters:
I20260807 06:56:05.286437 22920 raft_consensus.cc:2781] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:56:05.286520 22920 raft_consensus.cc:482] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:56:05.286604 22920 raft_consensus.cc:3037] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:05.288514 22920 raft_consensus.cc:504] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.289105 22920 leader_election.cc:288] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 election: Requested vote from peers 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829), c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485)
I20260807 06:56:05.289584 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174e8c3223f546ac8327dfe7bdfae476" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7"
I20260807 06:56:05.289624 22794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174e8c3223f546ac8327dfe7bdfae476" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c821700deda54bf3b0a0406055600c41"
I20260807 06:56:05.289839 22794 raft_consensus.cc:3037] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:05.289844 22621 raft_consensus.cc:3037] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:05.292505 22794 raft_consensus.cc:2454] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 1.
I20260807 06:56:05.292505 22621 raft_consensus.cc:2454] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 1.
I20260807 06:56:05.293012 22336 leader_election.cc:302] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 04e1f5a75bf04e598d2681e9f746ce4a, 8b76fd5e3302407688783d218b3798d7, c821700deda54bf3b0a0406055600c41; no voters:
I20260807 06:56:05.293330 22920 raft_consensus.cc:2781] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:05.293511 22920 raft_consensus.cc:686] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 LEADER]: Becoming Leader. State: Replica: 04e1f5a75bf04e598d2681e9f746ce4a, State: Running, Role: LEADER
I20260807 06:56:05.293771 22920 consensus_queue.cc:237] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.295203 22908 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: TxnStatusTablet state changed. Reason: New leader 04e1f5a75bf04e598d2681e9f746ce4a. Latest consensus state: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.295454 22908 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:56:05.296042 22950 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 06:56:05.296303 22950 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 06:56:05.296905 22215 catalog_manager.cc:5495] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129). New cstate: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } health_report { overall_health: UNKNOWN } } }
I20260807 06:56:05.325456 22952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.316060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40158 (local address 127.10.191.129:39343)
0807 06:56:05.320469 (+ 4409us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:05.320476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:05.320501 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:56:05.320580 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:05.320585 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:05.320673 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:05.320780 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:56:05.321287 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.322200 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.323520 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.323966 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.324099 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.324603 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:56:05.324755 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:56:05.324855 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:05.325090 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 06:56:05.325185 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4267,"thread_start_us":4123,"threads_started":1}
I20260807 06:56:05.325591 22942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.316070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:39343 (local address 127.0.0.1:40158)
0807 06:56:05.316380 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:05.316407 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:05.316588 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:05.320834 (+ 4246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:05.320838 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:05.320848 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:56:05.321116 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:05.321132 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.322357 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.322362 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:05.323371 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:05.323382 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.324134 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.324141 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:05.324311 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.324378 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:56:05.324891 (+ 513us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:56:05.324922 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:56:05.325024 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 06:56:05.325257 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 06:56:05.329674 22794 raft_consensus.cc:1261] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Refusing update from remote peer 04e1f5a75bf04e598d2681e9f746ce4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:05.329735 22621 raft_consensus.cc:1261] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Refusing update from remote peer 04e1f5a75bf04e598d2681e9f746ce4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:05.330358 22908 consensus_queue.cc:1035] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:05.330703 22920 consensus_queue.cc:1035] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:05.335942 22900 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: TxnStatusTablet state changed. Reason: New leader 04e1f5a75bf04e598d2681e9f746ce4a. Latest consensus state: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.336320 22900 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:56:05.339462 22900 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.339754 22900 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P c821700deda54bf3b0a0406055600c41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:56:05.345736 22920 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.346144 22920 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:56:05.364370 22908 consensus_queue.cc:1035] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:05.368459 22903 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: TxnStatusTablet state changed. Reason: New leader 04e1f5a75bf04e598d2681e9f746ce4a. Latest consensus state: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.368741 22903 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:56:05.370699 22952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.362155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:59939 (local address 127.10.191.129:39343)
0807 06:56:05.362542 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:05.362547 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:05.363068 (+ 521us) server_negotiation.cc:407] Connection header received
0807 06:56:05.363322 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:05.363326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:05.363402 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:05.363463 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:56:05.364220 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.365453 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.368077 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.369018 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.369184 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.369944 (+ 760us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:56:05.370095 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:56:05.370167 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:05.370329 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 06:56:05.370408 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235}
I20260807 06:56:05.371554 22965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.362177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:39343 (local address 127.10.191.129:59939)
0807 06:56:05.362956 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:05.362993 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:05.363184 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:05.363670 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:05.363674 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:05.363685 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 06:56:05.364055 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:05.364070 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.365622 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.365629 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:05.367876 (+ 2247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:05.367897 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.369519 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.369524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:05.369685 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.369766 (+ 81us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 06:56:05.370226 (+ 460us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 06:56:05.370233 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 06:56:05.371017 (+ 784us) client_negotiation.cc:240] Negotiation successful
0807 06:56:05.371146 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":4193,"threads_started":1}
I20260807 06:56:05.373709 22908 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.374037 22908 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P 04e1f5a75bf04e598d2681e9f746ce4a: This TxnStatusTablet replica's current role is: LEADER
I20260807 06:56:05.386008 22903 tablet_replica.cc:439] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } } }
I20260807 06:56:05.386361 22903 tablet_replica.cc:442] T 174e8c3223f546ac8327dfe7bdfae476 P 8b76fd5e3302407688783d218b3798d7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 06:56:05.397881 22908 consensus_queue.cc:1035] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:05.482475 22215 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:05.482781 22215 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:05.485860 22215 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451: Sending DeleteTablet for 3 replicas of tablet c376cd2a1a76460d81c7f9740c4b6e1a
I20260807 06:56:05.486851 22590 tablet_service.cc:1514] Processing DeleteTablet for tablet c376cd2a1a76460d81c7f9740c4b6e1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:05 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:41520
I20260807 06:56:05.486873 22399 tablet_service.cc:1514] Processing DeleteTablet for tablet c376cd2a1a76460d81c7f9740c4b6e1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:05 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:40140
I20260807 06:56:05.486900 22768 tablet_service.cc:1514] Processing DeleteTablet for tablet c376cd2a1a76460d81c7f9740c4b6e1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:05 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:38878
I20260807 06:56:05.501472 22980 tablet_replica.cc:330] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: stopping tablet replica
I20260807 06:56:05.501748 22980 raft_consensus.cc:2229] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:56:05.502372 22980 raft_consensus.cc:2258] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:05.503686 22980 ts_tablet_manager.cc:1905] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:05.512287 22980 ts_tablet_manager.cc:1918] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:56:05.512537 22980 log.cc:1196] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/c376cd2a1a76460d81c7f9740c4b6e1a
I20260807 06:56:05.513155 22980 ts_tablet_manager.cc:1939] T c376cd2a1a76460d81c7f9740c4b6e1a P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting consensus metadata
I20260807 06:56:05.514703 22194 catalog_manager.cc:4841] TS 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129:39343): tablet c376cd2a1a76460d81c7f9740c4b6e1a (table test-table [id=ca9f03817caa4b409052dbe57665d902]) successfully deleted
I20260807 06:56:05.514823 22979 tablet_replica.cc:330] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: stopping tablet replica
I20260807 06:56:05.515027 22979 raft_consensus.cc:2229] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:05.515384 22979 raft_consensus.cc:2258] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:05.516081 22978 tablet_replica.cc:330] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: stopping tablet replica
I20260807 06:56:05.516232 22978 raft_consensus.cc:2229] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:05.516418 22978 raft_consensus.cc:2258] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:05.517621 22978 ts_tablet_manager.cc:1905] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:05.520296 22979 ts_tablet_manager.cc:1905] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:05.525524 22978 ts_tablet_manager.cc:1918] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:56:05.525779 22978 log.cc:1196] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/c376cd2a1a76460d81c7f9740c4b6e1a
I20260807 06:56:05.526348 22978 ts_tablet_manager.cc:1939] T c376cd2a1a76460d81c7f9740c4b6e1a P 8b76fd5e3302407688783d218b3798d7: Deleting consensus metadata
I20260807 06:56:05.527740 22196 catalog_manager.cc:4841] TS 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829): tablet c376cd2a1a76460d81c7f9740c4b6e1a (table test-table [id=ca9f03817caa4b409052dbe57665d902]) successfully deleted
I20260807 06:56:05.528937 22979 ts_tablet_manager.cc:1918] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:56:05.529126 22979 log.cc:1196] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/c376cd2a1a76460d81c7f9740c4b6e1a
I20260807 06:56:05.529667 22979 ts_tablet_manager.cc:1939] T c376cd2a1a76460d81c7f9740c4b6e1a P c821700deda54bf3b0a0406055600c41: Deleting consensus metadata
I20260807 06:56:05.530975 22194 catalog_manager.cc:4841] TS c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485): tablet c376cd2a1a76460d81c7f9740c4b6e1a (table test-table [id=ca9f03817caa4b409052dbe57665d902]) successfully deleted
Aug 07 06:56:05 dist-test-slave-tfpf krb5kdc[22157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 06:56:05 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:05 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 06:56:05.583027 22991 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:05.571065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49558 (local address 127.10.191.190:43587)
0807 06:56:05.572224 (+ 1159us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:05.572229 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:05.572247 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:56:05.572321 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:05.572325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:05.572400 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:05.572541 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:05.574138 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.574980 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.576392 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.576861 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.577048 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.582669 (+ 5621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49558: BlockingRecv error: recv got EOF from 127.0.0.1:49558 (error 108)
Metrics: {"server-negotiator.queue_time_us":1041,"thread_start_us":847,"threads_started":1}
Aug 07 06:56:05 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM
I20260807 06:56:05.603191 22991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.586288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49572 (local address 127.10.191.190:43587)
0807 06:56:05.586484 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:05.586490 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:05.586799 (+ 309us) server_negotiation.cc:407] Connection header received
0807 06:56:05.586953 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:05.586957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:05.587056 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:05.587191 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:05.588525 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.589747 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.590956 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.591550 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.591686 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.596148 (+ 4462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:05.596154 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:05.596159 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:05.596208 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:05.600051 (+ 3843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:05.600921 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:05.600927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:05.600931 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:05.601144 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:05.601580 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:05.601585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:05.601588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:05.601999 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:05.602261 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:05.602528 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 06:56:05.602814 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 06:56:05.607402 22215 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:56:05.608142 22215 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:56:05.616218 22399 tablet_service.cc:1467] Processing CreateTablet for tablet 012d617a651e47a9863e706418ee6b62 (DEFAULT_TABLE table=test-table [id=c6f84444e6f243faaab1cf7b74188242]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:05.616441 22768 tablet_service.cc:1467] Processing CreateTablet for tablet 012d617a651e47a9863e706418ee6b62 (DEFAULT_TABLE table=test-table [id=c6f84444e6f243faaab1cf7b74188242]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:05.616441 22590 tablet_service.cc:1467] Processing CreateTablet for tablet 012d617a651e47a9863e706418ee6b62 (DEFAULT_TABLE table=test-table [id=c6f84444e6f243faaab1cf7b74188242]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:05.616816 22399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 012d617a651e47a9863e706418ee6b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:05.616957 22768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 012d617a651e47a9863e706418ee6b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:05.616957 22590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 012d617a651e47a9863e706418ee6b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:05.628899 23002 tablet_bootstrap.cc:492] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: Bootstrap starting.
I20260807 06:56:05.631732 23001 tablet_bootstrap.cc:492] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: Bootstrap starting.
I20260807 06:56:05.634549 23000 tablet_bootstrap.cc:492] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: Bootstrap starting.
I20260807 06:56:05.634613 23002 tablet_bootstrap.cc:654] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:05.635543 23001 tablet_bootstrap.cc:654] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:05.637323 23000 tablet_bootstrap.cc:654] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:05.646140 23000 tablet_bootstrap.cc:492] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: No bootstrap required, opened a new log
I20260807 06:56:05.646427 23000 ts_tablet_manager.cc:1397] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.010s
I20260807 06:56:05.647537 23001 tablet_bootstrap.cc:492] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: No bootstrap required, opened a new log
I20260807 06:56:05.647358 23000 raft_consensus.cc:348] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.647622 23000 raft_consensus.cc:374] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:05.647740 23000 raft_consensus.cc:729] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c821700deda54bf3b0a0406055600c41, State: Initialized, Role: FOLLOWER
I20260807 06:56:05.647845 23001 ts_tablet_manager.cc:1397] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.008s
I20260807 06:56:05.648079 23000 consensus_queue.cc:260] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.648705 23001 raft_consensus.cc:348] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.648943 23001 raft_consensus.cc:374] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:05.649031 23001 raft_consensus.cc:729] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b76fd5e3302407688783d218b3798d7, State: Initialized, Role: FOLLOWER
I20260807 06:56:05.649343 23001 consensus_queue.cc:260] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.651290 23002 tablet_bootstrap.cc:492] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: No bootstrap required, opened a new log
I20260807 06:56:05.651535 23002 ts_tablet_manager.cc:1397] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.014s
I20260807 06:56:05.651612 23000 ts_tablet_manager.cc:1428] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260807 06:56:05.652495 23002 raft_consensus.cc:348] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.652791 23002 raft_consensus.cc:374] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:05.652880 23002 raft_consensus.cc:729] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e1f5a75bf04e598d2681e9f746ce4a, State: Initialized, Role: FOLLOWER
I20260807 06:56:05.653151 23002 consensus_queue.cc:260] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.653399 23001 ts_tablet_manager.cc:1428] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260807 06:56:05.654619 23002 ts_tablet_manager.cc:1428] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 06:56:05.725694 22900 raft_consensus.cc:482] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:56:05.726001 22900 raft_consensus.cc:504] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.727974 22900 leader_election.cc:288] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129:39343), 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829)
I20260807 06:56:05.750902 23008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.728188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:43829 (local address 127.10.191.131:34561)
0807 06:56:05.745016 (+ 16828us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:05.745031 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:05.745225 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:05.745720 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:05.745732 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:05.745759 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:05.746186 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:05.746195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.747321 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.747328 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:05.748675 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:05.748688 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.750035 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.750042 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:05.750221 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.750258 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 06:56:05.750356 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:56:05.750502 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16724,"mutex_wait_us":167,"thread_start_us":16348,"threads_started":1}
I20260807 06:56:05.751252 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.729160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:34561 (local address 127.10.191.130:43829)
0807 06:56:05.744751 (+ 15591us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:05.744761 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:05.745195 (+ 434us) server_negotiation.cc:407] Connection header received
0807 06:56:05.745390 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:05.745395 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:05.745471 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:05.745581 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:05.746402 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.747161 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.748858 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.749825 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.750035 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.750116 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:05.750407 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 06:56:05.750911 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15408,"thread_start_us":15251,"threads_started":1}
I20260807 06:56:05.751889 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "012d617a651e47a9863e706418ee6b62" candidate_uuid: "c821700deda54bf3b0a0406055600c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7" is_pre_election: true
I20260807 06:56:05.752209 22621 raft_consensus.cc:2454] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c821700deda54bf3b0a0406055600c41 in term 0.
I20260807 06:56:05.752442 22952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.728689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:44209 (local address 127.10.191.129:39343)
0807 06:56:05.728950 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:05.728958 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:05.744366 (+ 15408us) server_negotiation.cc:407] Connection header received
0807 06:56:05.745263 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:05.745272 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:05.745373 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:05.745493 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:05.746096 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.747251 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.749546 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.750866 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.751011 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.751087 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:05.751969 (+ 882us) server_negotiation.cc:299] Negotiation successful
0807 06:56:05.752130 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 06:56:05.753222 23007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.728189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:39343 (local address 127.10.191.131:44209)
0807 06:56:05.744200 (+ 16011us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:05.744234 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:05.744995 (+ 761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:05.745517 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:05.745521 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:05.745547 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:05.745891 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:05.745909 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.747464 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.747469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:05.749361 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:05.749377 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.751631 (+ 2254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.751637 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:05.751793 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.751824 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:56:05.752632 (+ 808us) client_negotiation.cc:240] Negotiation successful
0807 06:56:05.752792 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15853,"thread_start_us":15687,"threads_started":1}
I20260807 06:56:05.753185 22712 leader_election.cc:302] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b76fd5e3302407688783d218b3798d7, c821700deda54bf3b0a0406055600c41; no voters:
I20260807 06:56:05.753700 22900 raft_consensus.cc:2781] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:56:05.753835 22900 raft_consensus.cc:482] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:56:05.753919 22900 raft_consensus.cc:3037] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:05.754230 22431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "012d617a651e47a9863e706418ee6b62" candidate_uuid: "c821700deda54bf3b0a0406055600c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" is_pre_election: true
I20260807 06:56:05.754637 22431 raft_consensus.cc:2454] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c821700deda54bf3b0a0406055600c41 in term 0.
I20260807 06:56:05.757107 22900 raft_consensus.cc:504] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.757810 22900 leader_election.cc:288] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [CANDIDATE]: Term 1 election: Requested vote from peers 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129:39343), 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829)
I20260807 06:56:05.758301 22431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "012d617a651e47a9863e706418ee6b62" candidate_uuid: "c821700deda54bf3b0a0406055600c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e1f5a75bf04e598d2681e9f746ce4a"
I20260807 06:56:05.758275 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "012d617a651e47a9863e706418ee6b62" candidate_uuid: "c821700deda54bf3b0a0406055600c41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7"
I20260807 06:56:05.758528 22431 raft_consensus.cc:3037] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:05.758548 22621 raft_consensus.cc:3037] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:05.760851 22621 raft_consensus.cc:2454] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c821700deda54bf3b0a0406055600c41 in term 1.
I20260807 06:56:05.761361 22712 leader_election.cc:302] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b76fd5e3302407688783d218b3798d7, c821700deda54bf3b0a0406055600c41; no voters:
I20260807 06:56:05.761698 22900 raft_consensus.cc:2781] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:05.762156 22431 raft_consensus.cc:2454] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c821700deda54bf3b0a0406055600c41 in term 1.
I20260807 06:56:05.762270 22900 raft_consensus.cc:686] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 1 LEADER]: Becoming Leader. State: Replica: c821700deda54bf3b0a0406055600c41, State: Running, Role: LEADER
I20260807 06:56:05.762948 22900 consensus_queue.cc:237] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.766963 22215 catalog_manager.cc:5495] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 reported cstate change: term changed from 0 to 1, leader changed from <none> to c821700deda54bf3b0a0406055600c41 (127.10.191.131). New cstate: current_term: 1 leader_uuid: "c821700deda54bf3b0a0406055600c41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } health_report { overall_health: HEALTHY } } }
I20260807 06:56:05.794173 23015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:05.788470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38888 (local address 127.10.191.131:39485)
0807 06:56:05.789168 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:05.789172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:05.789191 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:56:05.789279 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:05.789283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:05.789356 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:05.789493 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:56:05.789855 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.790588 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.791826 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:05.792208 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:05.792298 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:05.792763 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:56:05.793447 (+ 684us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:56:05.793566 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:05.793726 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 06:56:05.793796 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":390,"threads_started":1}
I20260807 06:56:05.798032 22621 raft_consensus.cc:1261] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Refusing update from remote peer c821700deda54bf3b0a0406055600c41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:05.798355 22431 raft_consensus.cc:1261] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Refusing update from remote peer c821700deda54bf3b0a0406055600c41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:05.798856 23010 consensus_queue.cc:1035] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:05.799288 22900 consensus_queue.cc:1035] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:05.818202 22214 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:05.818459 22214 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:05.821591 22214 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451: Sending DeleteTablet for 3 replicas of tablet 012d617a651e47a9863e706418ee6b62
I20260807 06:56:05.822522 22399 tablet_service.cc:1514] Processing DeleteTablet for tablet 012d617a651e47a9863e706418ee6b62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:05 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:40140
I20260807 06:56:05.822690 22590 tablet_service.cc:1514] Processing DeleteTablet for tablet 012d617a651e47a9863e706418ee6b62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:05 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:41520
I20260807 06:56:05.822914 22980 tablet_replica.cc:330] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: stopping tablet replica
I20260807 06:56:05.823160 22980 raft_consensus.cc:2229] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:05.823239 22768 tablet_service.cc:1514] Processing DeleteTablet for tablet 012d617a651e47a9863e706418ee6b62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:05 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:38878
I20260807 06:56:05.823434 22980 raft_consensus.cc:2258] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:05.823629 22979 tablet_replica.cc:330] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: stopping tablet replica
I20260807 06:56:05.823745 22978 tablet_replica.cc:330] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: stopping tablet replica
I20260807 06:56:05.823877 22979 raft_consensus.cc:2229] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:56:05.823956 22978 raft_consensus.cc:2229] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:05.824199 22978 raft_consensus.cc:2258] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:05.824332 22979 raft_consensus.cc:2258] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:05.825487 22978 ts_tablet_manager.cc:1905] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:05.825706 22979 ts_tablet_manager.cc:1905] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:05.825735 22214 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:56:05.826710 22214 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:56:05.832600 22979 ts_tablet_manager.cc:1918] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:56:05.832593 22978 ts_tablet_manager.cc:1918] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:56:05.832762 22978 log.cc:1196] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/012d617a651e47a9863e706418ee6b62
I20260807 06:56:05.832768 22979 log.cc:1196] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/012d617a651e47a9863e706418ee6b62
I20260807 06:56:05.833280 22978 ts_tablet_manager.cc:1939] T 012d617a651e47a9863e706418ee6b62 P 8b76fd5e3302407688783d218b3798d7: Deleting consensus metadata
I20260807 06:56:05.834195 22979 ts_tablet_manager.cc:1939] T 012d617a651e47a9863e706418ee6b62 P c821700deda54bf3b0a0406055600c41: Deleting consensus metadata
I20260807 06:56:05.834677 22196 catalog_manager.cc:4841] TS 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829): tablet 012d617a651e47a9863e706418ee6b62 (table test-table [id=c6f84444e6f243faaab1cf7b74188242]) successfully deleted
I20260807 06:56:05.835196 22980 ts_tablet_manager.cc:1905] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:05.836175 22590 tablet_service.cc:1467] Processing CreateTablet for tablet 64f57586c93e4b4bbb4994cf7c629874 (DEFAULT_TABLE table=test-table [id=afef640b7cb841d48ee58ed0ac7512c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:05.836575 22590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f57586c93e4b4bbb4994cf7c629874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:05.838325 22399 tablet_service.cc:1467] Processing CreateTablet for tablet 64f57586c93e4b4bbb4994cf7c629874 (DEFAULT_TABLE table=test-table [id=afef640b7cb841d48ee58ed0ac7512c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:05.838793 22399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f57586c93e4b4bbb4994cf7c629874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:05.843636 22980 ts_tablet_manager.cc:1918] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:56:05.843828 23001 tablet_bootstrap.cc:492] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: Bootstrap starting.
I20260807 06:56:05.843839 22980 log.cc:1196] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/012d617a651e47a9863e706418ee6b62
I20260807 06:56:05.844411 22980 ts_tablet_manager.cc:1939] T 012d617a651e47a9863e706418ee6b62 P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting consensus metadata
I20260807 06:56:05.845677 23001 tablet_bootstrap.cc:654] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:05.843351 22768 tablet_service.cc:1467] Processing CreateTablet for tablet 64f57586c93e4b4bbb4994cf7c629874 (DEFAULT_TABLE table=test-table [id=afef640b7cb841d48ee58ed0ac7512c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:05.846589 23002 tablet_bootstrap.cc:492] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: Bootstrap starting.
I20260807 06:56:05.846761 22194 catalog_manager.cc:4841] TS c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485): tablet 012d617a651e47a9863e706418ee6b62 (table test-table [id=c6f84444e6f243faaab1cf7b74188242]) successfully deleted
I20260807 06:56:05.846882 22768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64f57586c93e4b4bbb4994cf7c629874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:05.847666 22194 catalog_manager.cc:4841] TS 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129:39343): tablet 012d617a651e47a9863e706418ee6b62 (table test-table [id=c6f84444e6f243faaab1cf7b74188242]) successfully deleted
I20260807 06:56:05.848434 23002 tablet_bootstrap.cc:654] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:05.853991 23002 tablet_bootstrap.cc:492] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: No bootstrap required, opened a new log
I20260807 06:56:05.854182 23002 ts_tablet_manager.cc:1397] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 06:56:05.855038 23002 raft_consensus.cc:348] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.855329 23002 raft_consensus.cc:374] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:05.855414 23002 raft_consensus.cc:729] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e1f5a75bf04e598d2681e9f746ce4a, State: Initialized, Role: FOLLOWER
I20260807 06:56:05.855584 23000 tablet_bootstrap.cc:492] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: Bootstrap starting.
I20260807 06:56:05.855712 23002 consensus_queue.cc:260] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.856389 23002 ts_tablet_manager.cc:1428] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:56:05.857511 23000 tablet_bootstrap.cc:654] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:05.860110 23000 tablet_bootstrap.cc:492] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: No bootstrap required, opened a new log
I20260807 06:56:05.860316 23000 ts_tablet_manager.cc:1397] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 06:56:05.861166 23000 raft_consensus.cc:348] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.861529 23000 raft_consensus.cc:374] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:05.861629 23000 raft_consensus.cc:729] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c821700deda54bf3b0a0406055600c41, State: Initialized, Role: FOLLOWER
I20260807 06:56:05.861929 23000 consensus_queue.cc:260] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.862632 23000 ts_tablet_manager.cc:1428] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 06:56:05.868381 23001 tablet_bootstrap.cc:492] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: No bootstrap required, opened a new log
I20260807 06:56:05.868592 23001 ts_tablet_manager.cc:1397] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.003s
I20260807 06:56:05.869464 23001 raft_consensus.cc:348] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.869716 23001 raft_consensus.cc:374] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:05.869804 23001 raft_consensus.cc:729] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b76fd5e3302407688783d218b3798d7, State: Initialized, Role: FOLLOWER
I20260807 06:56:05.870093 23001 consensus_queue.cc:260] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:05.870659 23001 ts_tablet_manager.cc:1428] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 06:56:06.158151 22969 raft_consensus.cc:482] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:56:06.158432 22969 raft_consensus.cc:504] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:06.159322 22969 leader_election.cc:288] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829), c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485)
I20260807 06:56:06.159857 22794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f57586c93e4b4bbb4994cf7c629874" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c821700deda54bf3b0a0406055600c41" is_pre_election: true
I20260807 06:56:06.159898 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f57586c93e4b4bbb4994cf7c629874" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7" is_pre_election: true
I20260807 06:56:06.160175 22794 raft_consensus.cc:2454] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 0.
I20260807 06:56:06.160238 22621 raft_consensus.cc:2454] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 0.
I20260807 06:56:06.160712 22336 leader_election.cc:302] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e1f5a75bf04e598d2681e9f746ce4a, c821700deda54bf3b0a0406055600c41; no voters:
I20260807 06:56:06.160969 22969 raft_consensus.cc:2781] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:56:06.161123 22969 raft_consensus.cc:482] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:56:06.161212 22969 raft_consensus.cc:3037] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:06.163105 22969 raft_consensus.cc:504] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:06.163625 22969 leader_election.cc:288] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 election: Requested vote from peers 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829), c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485)
I20260807 06:56:06.164134 22794 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f57586c93e4b4bbb4994cf7c629874" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c821700deda54bf3b0a0406055600c41"
I20260807 06:56:06.164142 22621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64f57586c93e4b4bbb4994cf7c629874" candidate_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b76fd5e3302407688783d218b3798d7"
I20260807 06:56:06.164436 22794 raft_consensus.cc:3037] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:06.164433 22621 raft_consensus.cc:3037] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:06.166735 22794 raft_consensus.cc:2454] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 1.
I20260807 06:56:06.167186 22336 leader_election.cc:302] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e1f5a75bf04e598d2681e9f746ce4a, c821700deda54bf3b0a0406055600c41; no voters:
I20260807 06:56:06.167507 22969 raft_consensus.cc:2781] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:06.167625 22621 raft_consensus.cc:2454] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e1f5a75bf04e598d2681e9f746ce4a in term 1.
I20260807 06:56:06.168197 22969 raft_consensus.cc:686] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 LEADER]: Becoming Leader. State: Replica: 04e1f5a75bf04e598d2681e9f746ce4a, State: Running, Role: LEADER
I20260807 06:56:06.168627 22969 consensus_queue.cc:237] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } }
I20260807 06:56:06.171900 22215 catalog_manager.cc:5495] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129). New cstate: current_term: 1 leader_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e1f5a75bf04e598d2681e9f746ce4a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 } health_report { overall_health: UNKNOWN } } }
I20260807 06:56:06.244338 22952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:06.239250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40168 (local address 127.10.191.129:39343)
0807 06:56:06.239417 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:06.239422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:06.239524 (+ 102us) server_negotiation.cc:407] Connection header received
0807 06:56:06.239697 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:06.239700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:06.239764 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:06.239853 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:56:06.240313 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:06.241004 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:06.242624 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:06.243027 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:06.243121 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:06.243641 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:56:06.243740 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:56:06.243809 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:06.243975 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 06:56:06.244041 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:56:06.254467 22621 raft_consensus.cc:1261] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Refusing update from remote peer 04e1f5a75bf04e598d2681e9f746ce4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:06.254467 22794 raft_consensus.cc:1261] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Refusing update from remote peer 04e1f5a75bf04e598d2681e9f746ce4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:06.255101 22969 consensus_queue.cc:1035] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b76fd5e3302407688783d218b3798d7" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:06.255453 23025 consensus_queue.cc:1035] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c821700deda54bf3b0a0406055600c41" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:06.297283 22214 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:06.297557 22214 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:06.300501 22214 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b63e8bb858d46c380e055b61627c451: Sending DeleteTablet for 3 replicas of tablet 64f57586c93e4b4bbb4994cf7c629874
I20260807 06:56:06.301393 22398 tablet_service.cc:1514] Processing DeleteTablet for tablet 64f57586c93e4b4bbb4994cf7c629874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:06 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:40140
I20260807 06:56:06.301508 22590 tablet_service.cc:1514] Processing DeleteTablet for tablet 64f57586c93e4b4bbb4994cf7c629874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:06 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:41520
I20260807 06:56:06.301512 22768 tablet_service.cc:1514] Processing DeleteTablet for tablet 64f57586c93e4b4bbb4994cf7c629874 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:06 UTC) from {username='oryx', principal='oryx/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:38878
I20260807 06:56:06.301748 22980 tablet_replica.cc:330] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: stopping tablet replica
I20260807 06:56:06.301826 22978 tablet_replica.cc:330] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: stopping tablet replica
I20260807 06:56:06.301968 22980 raft_consensus.cc:2229] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:56:06.302037 22979 tablet_replica.cc:330] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: stopping tablet replica
I20260807 06:56:06.302037 22978 raft_consensus.cc:2229] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:06.302196 22979 raft_consensus.cc:2229] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:06.302258 22978 raft_consensus.cc:2258] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:06.302322 22980 raft_consensus.cc:2258] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:06.302390 22979 raft_consensus.cc:2258] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:06.303413 22980 ts_tablet_manager.cc:1905] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:06.303550 22979 ts_tablet_manager.cc:1905] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:06.303870 22978 ts_tablet_manager.cc:1905] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:06.304464 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 22317
I20260807 06:56:06.311478 22980 ts_tablet_manager.cc:1918] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:56:06.311463 22979 ts_tablet_manager.cc:1918] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:56:06.311625 22979 log.cc:1196] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/64f57586c93e4b4bbb4994cf7c629874
I20260807 06:56:06.311815 22980 log.cc:1196] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/64f57586c93e4b4bbb4994cf7c629874
I20260807 06:56:06.312129 22979 ts_tablet_manager.cc:1939] T 64f57586c93e4b4bbb4994cf7c629874 P c821700deda54bf3b0a0406055600c41: Deleting consensus metadata
I20260807 06:56:06.312309 22980 ts_tablet_manager.cc:1939] T 64f57586c93e4b4bbb4994cf7c629874 P 04e1f5a75bf04e598d2681e9f746ce4a: Deleting consensus metadata
I20260807 06:56:06.313046 22978 ts_tablet_manager.cc:1918] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 06:56:06.313334 22978 log.cc:1196] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/64f57586c93e4b4bbb4994cf7c629874
I20260807 06:56:06.313581 22194 catalog_manager.cc:4841] TS 04e1f5a75bf04e598d2681e9f746ce4a (127.10.191.129:39343): tablet 64f57586c93e4b4bbb4994cf7c629874 (table test-table [id=afef640b7cb841d48ee58ed0ac7512c7]) successfully deleted
I20260807 06:56:06.313890 22194 catalog_manager.cc:4841] TS c821700deda54bf3b0a0406055600c41 (127.10.191.131:39485): tablet 64f57586c93e4b4bbb4994cf7c629874 (table test-table [id=afef640b7cb841d48ee58ed0ac7512c7]) successfully deleted
I20260807 06:56:06.314036 22978 ts_tablet_manager.cc:1939] T 64f57586c93e4b4bbb4994cf7c629874 P 8b76fd5e3302407688783d218b3798d7: Deleting consensus metadata
I20260807 06:56:06.315452 22196 catalog_manager.cc:4841] TS 8b76fd5e3302407688783d218b3798d7 (127.10.191.130:43829): tablet 64f57586c93e4b4bbb4994cf7c629874 (table test-table [id=afef640b7cb841d48ee58ed0ac7512c7]) successfully deleted
Aug 07 06:56:06 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.129@KRBTEST.COM
I20260807 06:56:06.328809 22952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:06.306049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40170 (local address 127.10.191.129:39343)
0807 06:56:06.306196 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:06.306206 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:06.315261 (+ 9055us) server_negotiation.cc:407] Connection header received
0807 06:56:06.315347 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:06.315354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:06.315441 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:06.315566 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:06.316862 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:06.317648 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:06.318806 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:06.319168 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:06.319272 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:06.323208 (+ 3936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:06.323225 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:06.323243 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:06.323279 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:06.326292 (+ 3013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:06.327010 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:06.327018 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:06.327020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:06.327181 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:06.327513 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:06.327516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:06.327518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:06.327899 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:06.328126 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:06.328371 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 06:56:06.328549 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 06:56:06.329581 22486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:06.477571 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 22317
I20260807 06:56:06.515931 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 22501
Aug 07 06:56:06 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.130@KRBTEST.COM
I20260807 06:56:06.535987 23037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:06.516829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37668 (local address 127.10.191.130:43829)
0807 06:56:06.517341 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:06.517346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:06.517363 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:56:06.517421 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:06.517425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:06.517483 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:06.517580 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:06.518752 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:06.519426 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:06.520778 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:06.521377 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:06.521476 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:06.530221 (+ 8745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:06.530238 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:06.530258 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:06.530306 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:06.533161 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:06.533819 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:06.533827 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:06.533829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:06.533965 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:06.534390 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:06.534394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:06.534396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:06.534867 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:06.535118 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:06.535393 (+ 275us) server_negotiation.cc:299] Negotiation successful
0807 06:56:06.535596 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":303,"threads_started":1}
I20260807 06:56:06.536700 22680 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:06.630769 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 22501
I20260807 06:56:06.661046 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 22689
Aug 07 06:56:06 dist-test-slave-tfpf krb5kdc[22157](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.191.131@KRBTEST.COM
I20260807 06:56:06.679220 23041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:06.661952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59738 (local address 127.10.191.131:39485)
0807 06:56:06.662473 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:06.662477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:06.662494 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:56:06.662551 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:06.662554 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:06.662630 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:06.662722 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:06.664462 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:06.665258 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:06.667120 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:06.667675 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:06.667778 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:06.673312 (+ 5534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:06.673332 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:06.673354 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:06.673398 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:06.676636 (+ 3238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:06.677454 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:06.677462 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:06.677464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:06.677595 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:06.677956 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:06.677959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:06.677961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:06.678306 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:06.678523 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:06.678771 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 06:56:06.678939 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":306,"threads_started":1}
I20260807 06:56:06.679932 22855 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:06.800913 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 22689
I20260807 06:56:06.831890 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 22171
I20260807 06:56:06.833382 22273 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:06.975744 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 22171
2026-08-07T06:56:07Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6332 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:56:07 dist-test-slave-tfpf krb5kdc[23049](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:56:07 dist-test-slave-tfpf krb5kdc[23049](info): set up 2 sockets
Aug 07 06:56:07 dist-test-slave-tfpf krb5kdc[23049](info): commencing operation
krb5kdc: starting...
W20260807 06:56:08.269032 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:56:08 dist-test-slave-tfpf krb5kdc[23049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:56:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:56:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:56:08.574867 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42129
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:42129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:08.935626 23066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:08.935971 23066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:08.936060 23066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:08.943248 23066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:56:08.943406 23066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:08.943455 23066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:08.943535 23066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:56:08.943625 23066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:56:08.953261 23066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:42129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:08.954761 23066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:08.956182 23066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:08.968847 23073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:08.969388 23072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:08.969944 23076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:08.970468 23066 server_base.cc:1034] running on GCE node
I20260807 06:56:08.971540 23066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:08.973564 23066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:08.974813 23066 hybrid_clock.cc:648] HybridClock initialized: now 1786085768974724 us; error 53 us; skew 500 ppm
I20260807 06:56:08.975236 23066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T06:56:09Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2066 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:56:09 dist-test-slave-tfpf krb5kdc[23086](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:56:09 dist-test-slave-tfpf krb5kdc[23086](info): set up 2 sockets
Aug 07 06:56:09 dist-test-slave-tfpf krb5kdc[23086](info): commencing operation
krb5kdc: starting...
W20260807 06:56:10.325460 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.016s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:56:10 dist-test-slave-tfpf krb5kdc[23086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:56:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:56:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:56:10.636579 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36275
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:42433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:36275
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:11.002471 23102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:11.002779 23102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:11.002866 23102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:11.010368 23102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:56:11.010502 23102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:11.010550 23102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:11.010608 23102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:56:11.010644 23102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:56:11.020776 23102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:42433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:36275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:11.022219 23102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:11.023517 23102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:11.035250 23108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:11.035231 23111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:11.035204 23109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:11.036299 23102 server_base.cc:1034] running on GCE node
I20260807 06:56:11.037065 23102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:11.038606 23102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:11.039855 23102 hybrid_clock.cc:648] HybridClock initialized: now 1786085771039805 us; error 59 us; skew 500 ppm
I20260807 06:56:11.040225 23102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:11 dist-test-slave-tfpf krb5kdc[23086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085771, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:11.043576 23102 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:56:11.045322 23102 webserver.cc:460] Webserver started at http://127.10.191.190:38477/ using document root <none> and password file <none>
I20260807 06:56:11.046092 23102 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:11.046242 23102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:11.046582 23102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:11.049851 23102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "176f11a623b04fc49bc07e1db79119d1"
format_stamp: "Formatted at 2026-08-07 06:56:11 on dist-test-slave-tfpf"
server_key: "194127aa360bbc0bd12c7b521b64f02b"
server_key_iv: "4660943480d5dd87feff9ff1f2f7c491"
server_key_version: "encryptionkey@0"
I20260807 06:56:11.050661 23102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "176f11a623b04fc49bc07e1db79119d1"
format_stamp: "Formatted at 2026-08-07 06:56:11 on dist-test-slave-tfpf"
server_key: "194127aa360bbc0bd12c7b521b64f02b"
server_key_iv: "4660943480d5dd87feff9ff1f2f7c491"
server_key_version: "encryptionkey@0"
I20260807 06:56:11.056126 23102 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 06:56:11.059957 23118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:11.061394 23102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:56:11.061596 23102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "176f11a623b04fc49bc07e1db79119d1"
format_stamp: "Formatted at 2026-08-07 06:56:11 on dist-test-slave-tfpf"
server_key: "194127aa360bbc0bd12c7b521b64f02b"
server_key_iv: "4660943480d5dd87feff9ff1f2f7c491"
server_key_version: "encryptionkey@0"
I20260807 06:56:11.061812 23102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:11.076637 23102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:11.080921 23102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:11.081276 23102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:11.101496 23102 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:36275
I20260807 06:56:11.101517 23186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:36275 every 8 connection(s)
I20260807 06:56:11.103051 23102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:56:11.107051 23187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:11.111228 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 23102
I20260807 06:56:11.111500 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:56:11.112371 11006 external_mini_cluster.cc:1428] Setting key 336b0d801c219621fb065178314eda01
I20260807 06:56:11.122051 23187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: Bootstrap starting.
I20260807 06:56:11.126288 23187 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:11.127714 23187 log.cc:824] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: Log is configured to *not* fsync() on all Append() calls
Aug 07 06:56:11 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:56:11.131206 23187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: No bootstrap required, opened a new log
I20260807 06:56:11.137054 23191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:11.114688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46004 (local address 127.10.191.190:36275)
0807 06:56:11.115541 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:11.115554 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:11.115600 (+ 46us) server_negotiation.cc:407] Connection header received
0807 06:56:11.117387 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:11.117410 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:11.117828 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:11.118175 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:11.120145 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:11.121507 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:11.123306 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:11.123977 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:11.124121 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:11.129161 (+ 5040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:11.129172 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:11.129189 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:11.129233 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:11.132448 (+ 3215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:11.133307 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:11.133314 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:11.133320 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:11.133512 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:11.133976 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:11.133981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:11.133985 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:11.134595 (+ 610us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:11.134953 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:11.135472 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 06:56:11.135944 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":424,"threads_started":1}
I20260807 06:56:11.139600 23187 raft_consensus.cc:348] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } }
I20260807 06:56:11.140000 23187 raft_consensus.cc:374] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:11.140136 23187 raft_consensus.cc:729] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176f11a623b04fc49bc07e1db79119d1, State: Initialized, Role: FOLLOWER
I20260807 06:56:11.140775 23187 consensus_queue.cc:260] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } }
I20260807 06:56:11.141039 23187 raft_consensus.cc:388] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:56:11.141217 23187 raft_consensus.cc:482] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:56:11.141410 23187 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:11.143539 23187 raft_consensus.cc:504] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } }
I20260807 06:56:11.144150 23187 leader_election.cc:302] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 176f11a623b04fc49bc07e1db79119d1; no voters:
I20260807 06:56:11.144878 23187 leader_election.cc:288] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:56:11.144999 23194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:11.146204 23194 raft_consensus.cc:686] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 1 LEADER]: Becoming Leader. State: Replica: 176f11a623b04fc49bc07e1db79119d1, State: Running, Role: LEADER
I20260807 06:56:11.146812 23194 consensus_queue.cc:237] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } }
I20260807 06:56:11.147488 23187 sys_catalog.cc:564] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:56:11.149739 23196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 176f11a623b04fc49bc07e1db79119d1. Latest consensus state: current_term: 1 leader_uuid: "176f11a623b04fc49bc07e1db79119d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } } }
I20260807 06:56:11.150144 23196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:11.150621 23195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "176f11a623b04fc49bc07e1db79119d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } } }
I20260807 06:56:11.150887 23195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:11.151894 23206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:56:11.156783 23206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:56:11.165714 23206 catalog_manager.cc:1347] Generated new cluster ID: f5d757ec4ab64ec39239137c6a53ded6
I20260807 06:56:11.165854 23206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:56:11.190333 23206 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:56:11.192392 23206 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:56:11.215409 23206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: Generated new TSK 0
I20260807 06:56:11.216425 23206 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:56:11.291023 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36275
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:42433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:11.645020 23223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:11.645407 23223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:11.645586 23223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:11.653307 23223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:11.653461 23223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:11.653640 23223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:56:11.663798 23223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:42433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:11.665400 23223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:11.666941 23223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:11.680408 23234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:11.680546 23231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:11.680469 23230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:11.681680 23223 server_base.cc:1034] running on GCE node
I20260807 06:56:11.682331 23223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:11.683413 23223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:11.684640 23223 hybrid_clock.cc:648] HybridClock initialized: now 1786085771684596 us; error 44 us; skew 500 ppm
I20260807 06:56:11.685005 23223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:11 dist-test-slave-tfpf krb5kdc[23086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085771, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:11.688269 23223 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:56:11.689851 23223 webserver.cc:460] Webserver started at http://127.10.191.129:40007/ using document root <none> and password file <none>
I20260807 06:56:11.690544 23223 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:11.690647 23223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:11.690915 23223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:11.694036 23223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "fec0dc861031465a96d0b5c14c6289b1"
format_stamp: "Formatted at 2026-08-07 06:56:11 on dist-test-slave-tfpf"
server_key: "8a75dc39ff9c070b61202255652758ca"
server_key_iv: "c09d12a62135788afe2e28053685c275"
server_key_version: "encryptionkey@0"
I20260807 06:56:11.694818 23223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "fec0dc861031465a96d0b5c14c6289b1"
format_stamp: "Formatted at 2026-08-07 06:56:11 on dist-test-slave-tfpf"
server_key: "8a75dc39ff9c070b61202255652758ca"
server_key_iv: "c09d12a62135788afe2e28053685c275"
server_key_version: "encryptionkey@0"
I20260807 06:56:11.700333 23223 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:56:11.704200 23243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:11.705758 23223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 06:56:11.705940 23223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "fec0dc861031465a96d0b5c14c6289b1"
format_stamp: "Formatted at 2026-08-07 06:56:11 on dist-test-slave-tfpf"
server_key: "8a75dc39ff9c070b61202255652758ca"
server_key_iv: "c09d12a62135788afe2e28053685c275"
server_key_version: "encryptionkey@0"
I20260807 06:56:11.706174 23223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:11.720759 23223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:11.725456 23223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:11.725786 23223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:11.726773 23223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:11.728145 23223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:11.728229 23223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:11.728382 23223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:11.728441 23223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:11.762707 23223 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:36853
I20260807 06:56:11.762809 23386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:36853 every 8 connection(s)
I20260807 06:56:11.764060 23223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:56:11.773276 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 23223
I20260807 06:56:11.773492 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:56:11.774142 11006 external_mini_cluster.cc:1428] Setting key a05ff613d5b62d214b0a087f4f0d72e0
Aug 07 06:56:11 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085771, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:56:11.785104 23389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:11.766839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:57107 (local address 127.10.191.190:36275)
0807 06:56:11.767308 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:11.767312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:11.768326 (+ 1014us) server_negotiation.cc:407] Connection header received
0807 06:56:11.770207 (+ 1881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:11.770212 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:11.770305 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:11.770422 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:11.771978 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:11.772714 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:11.774468 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:11.774993 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:11.775140 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:11.779088 (+ 3948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:11.779093 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:11.779097 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:11.779131 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:11.781753 (+ 2622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:11.782539 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:11.782544 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:11.782546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:11.782670 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:11.783180 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:11.783184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:11.783186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:11.783475 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:11.783643 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:11.784440 (+ 797us) server_negotiation.cc:299] Negotiation successful
0807 06:56:11.784683 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":240,"threads_started":1}
I20260807 06:56:11.786146 23391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:11.767443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:57107)
0807 06:56:11.768176 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:11.768212 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:11.769932 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:11.770670 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:11.770680 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:11.771227 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:11.771800 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:11.771817 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:11.772906 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:11.772910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:11.774315 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:11.774329 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:11.775250 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:11.775259 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:11.775522 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:11.776278 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:11.776300 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:11.778837 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:11.781917 (+ 3080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:11.781927 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:11.781946 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:11.782391 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:11.782790 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:11.782795 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:11.782798 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:11.783039 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:11.783619 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:11.783627 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:11.784012 (+ 385us) client_negotiation.cc:769] Sending connection context
0807 06:56:11.784314 (+ 302us) client_negotiation.cc:240] Negotiation successful
0807 06:56:11.784930 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":280,"threads_started":1}
I20260807 06:56:11.787746 23387 heartbeater.cc:347] Connected to a master server at 127.10.191.190:36275
I20260807 06:56:11.788093 23387 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:11.788859 23387 heartbeater.cc:511] Master 127.10.191.190:36275 requested a full tablet report, sending...
I20260807 06:56:11.791211 23139 ts_manager.cc:194] Registered new tserver with Master: fec0dc861031465a96d0b5c14c6289b1 (127.10.191.129:36853)
I20260807 06:56:11.792706 23139 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:57107
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:56:11.838503 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36275
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:42433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:12.187300 23396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:12.187619 23396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:12.187716 23396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:12.195084 23396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:12.195210 23396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:12.195328 23396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:56:12.205336 23396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:42433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:12.206751 23396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:12.208122 23396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:12.222985 23403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:12.223018 23401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:12.222985 23407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:12.223984 23396 server_base.cc:1034] running on GCE node
I20260807 06:56:12.224768 23396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:12.225910 23396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:12.227178 23396 hybrid_clock.cc:648] HybridClock initialized: now 1786085772227104 us; error 58 us; skew 500 ppm
I20260807 06:56:12.227556 23396 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:12 dist-test-slave-tfpf krb5kdc[23086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085772, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:12.231060 23396 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:56:12.232728 23396 webserver.cc:460] Webserver started at http://127.10.191.130:37027/ using document root <none> and password file <none>
I20260807 06:56:12.233565 23396 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:12.233696 23396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:12.233983 23396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:12.237047 23396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "09c6c0e1412f47cc9df9a97beff65e4a"
format_stamp: "Formatted at 2026-08-07 06:56:12 on dist-test-slave-tfpf"
server_key: "64fb0f8affa7a0ce3043f22a935e79e3"
server_key_iv: "45626b83579119b5e20e22bfb175cc76"
server_key_version: "encryptionkey@0"
I20260807 06:56:12.237954 23396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "09c6c0e1412f47cc9df9a97beff65e4a"
format_stamp: "Formatted at 2026-08-07 06:56:12 on dist-test-slave-tfpf"
server_key: "64fb0f8affa7a0ce3043f22a935e79e3"
server_key_iv: "45626b83579119b5e20e22bfb175cc76"
server_key_version: "encryptionkey@0"
I20260807 06:56:12.243175 23396 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 06:56:12.246846 23416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:12.248412 23396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:56:12.248607 23396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "09c6c0e1412f47cc9df9a97beff65e4a"
format_stamp: "Formatted at 2026-08-07 06:56:12 on dist-test-slave-tfpf"
server_key: "64fb0f8affa7a0ce3043f22a935e79e3"
server_key_iv: "45626b83579119b5e20e22bfb175cc76"
server_key_version: "encryptionkey@0"
I20260807 06:56:12.248896 23396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:12.261535 23396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:12.266038 23396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:12.266376 23396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:12.267436 23396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:12.268843 23396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:12.268915 23396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:12.268996 23396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:12.269040 23396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:12.301396 23396 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:38523
I20260807 06:56:12.301447 23568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:38523 every 8 connection(s)
I20260807 06:56:12.302778 23396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:56:12.310657 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 23396
I20260807 06:56:12.310850 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:56:12.311426 11006 external_mini_cluster.cc:1428] Setting key 4ed125a0d58d8ae41a69d800b97453c9
Aug 07 06:56:12 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085772, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:56:12.326910 23572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:12.305562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:59079 (local address 127.10.191.190:36275)
0807 06:56:12.306075 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:12.306092 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:12.306900 (+ 808us) server_negotiation.cc:407] Connection header received
0807 06:56:12.308684 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:12.308689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:12.308853 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:12.309051 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:12.310988 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:12.311846 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:12.313817 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:12.314283 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:12.314449 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:12.318619 (+ 4170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:12.318627 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:12.318634 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:12.318681 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:12.322538 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:12.323693 (+ 1155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:12.323701 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:12.323707 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:12.323892 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:12.324471 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:12.324478 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:12.324483 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:12.324872 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:12.325116 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:12.326183 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0807 06:56:12.326443 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":283,"threads_started":1}
I20260807 06:56:12.328199 23573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:12.306025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:59079)
0807 06:56:12.306733 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:12.306777 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:12.308410 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:12.309338 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:12.309346 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:12.310021 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:12.310708 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:12.310754 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:12.312028 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:12.312039 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:12.313645 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:12.313659 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:12.314561 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:12.314568 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:12.314815 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:12.315684 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:12.315709 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:12.318354 (+ 2645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:12.322755 (+ 4401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:12.322767 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:12.322789 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:12.323527 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:12.324035 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:12.324044 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:12.324049 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:12.324335 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:12.325086 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:12.325097 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:12.325644 (+ 547us) client_negotiation.cc:769] Sending connection context
0807 06:56:12.326038 (+ 394us) client_negotiation.cc:240] Negotiation successful
0807 06:56:12.326673 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":265,"threads_started":1}
I20260807 06:56:12.329913 23570 heartbeater.cc:347] Connected to a master server at 127.10.191.190:36275
I20260807 06:56:12.330302 23570 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:12.331103 23570 heartbeater.cc:511] Master 127.10.191.190:36275 requested a full tablet report, sending...
I20260807 06:56:12.332962 23139 ts_manager.cc:194] Registered new tserver with Master: 09c6c0e1412f47cc9df9a97beff65e4a (127.10.191.130:38523)
I20260807 06:56:12.333901 23139 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:59079
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:56:12.378881 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36275
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:42433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:12.726712 23576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:12.727046 23576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:12.727149 23576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:12.733963 23576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:12.734084 23576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:12.734196 23576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:56:12.743861 23576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:42433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:36275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:12.745440 23576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:12.747164 23576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:12.761427 23583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:12.761406 23587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:12.761372 23584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:12.762351 23576 server_base.cc:1034] running on GCE node
I20260807 06:56:12.763041 23576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:12.764019 23576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:12.765239 23576 hybrid_clock.cc:648] HybridClock initialized: now 1786085772765181 us; error 49 us; skew 500 ppm
I20260807 06:56:12.765576 23576 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:12 dist-test-slave-tfpf krb5kdc[23086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085772, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:12.769011 23576 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:56:12.770563 23576 webserver.cc:460] Webserver started at http://127.10.191.131:45669/ using document root <none> and password file <none>
I20260807 06:56:12.771265 23576 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:12.771412 23576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:12.771730 23576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:12.774662 23576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "6a0440996bf6420786861586a62fcf5b"
format_stamp: "Formatted at 2026-08-07 06:56:12 on dist-test-slave-tfpf"
server_key: "c3eb9ebc4c00b52cb7931d2a1a713d22"
server_key_iv: "118156ae39a9e2420f5143be1eb9be69"
server_key_version: "encryptionkey@0"
I20260807 06:56:12.775509 23576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "6a0440996bf6420786861586a62fcf5b"
format_stamp: "Formatted at 2026-08-07 06:56:12 on dist-test-slave-tfpf"
server_key: "c3eb9ebc4c00b52cb7931d2a1a713d22"
server_key_iv: "118156ae39a9e2420f5143be1eb9be69"
server_key_version: "encryptionkey@0"
I20260807 06:56:12.780884 23576 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 06:56:12.784634 23595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:12.786139 23576 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:56:12.786356 23576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "6a0440996bf6420786861586a62fcf5b"
format_stamp: "Formatted at 2026-08-07 06:56:12 on dist-test-slave-tfpf"
server_key: "c3eb9ebc4c00b52cb7931d2a1a713d22"
server_key_iv: "118156ae39a9e2420f5143be1eb9be69"
server_key_version: "encryptionkey@0"
I20260807 06:56:12.786590 23576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:12.795707 23387 heartbeater.cc:503] Master 127.10.191.190:36275 was elected leader, sending a full tablet report...
I20260807 06:56:12.802062 23576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:12.807482 23576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:12.807825 23576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:12.808993 23576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:12.810802 23576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:12.810889 23576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:12.811002 23576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:12.811069 23576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:12.845834 23576 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:40189
I20260807 06:56:12.845880 23751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:40189 every 8 connection(s)
I20260807 06:56:12.847205 23576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:56:12.850692 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 23576
I20260807 06:56:12.850912 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:56:12.851692 11006 external_mini_cluster.cc:1428] Setting key e9c1b496662a9f069db93700305b1708
Aug 07 06:56:12 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085772, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:56:12.870702 23754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:12.849928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:39517 (local address 127.10.191.190:36275)
0807 06:56:12.850456 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:12.850461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:12.854278 (+ 3817us) server_negotiation.cc:407] Connection header received
0807 06:56:12.855880 (+ 1602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:12.855885 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:12.855972 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:12.856108 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:12.857832 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:12.858603 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:12.860004 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:12.860387 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:12.860491 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:12.864125 (+ 3634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:12.864130 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:12.864133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:12.864169 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:12.867320 (+ 3151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:12.868337 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:12.868341 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:12.868343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:12.868470 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:12.868985 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:12.868988 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:12.868990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:12.869365 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:12.869486 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:12.870246 (+ 760us) server_negotiation.cc:299] Negotiation successful
0807 06:56:12.870424 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":289,"threads_started":1}
I20260807 06:56:12.871724 23756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:12.850508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:39517)
0807 06:56:12.852961 (+ 2453us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:12.853016 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:12.855609 (+ 2593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:12.856401 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:12.856413 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:12.857022 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:12.857673 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:12.857691 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:12.858724 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:12.858728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:12.859880 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:12.859893 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:12.860576 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:12.860580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:12.860755 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:12.861460 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:12.861482 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:12.863914 (+ 2432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:12.867481 (+ 3567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:12.867489 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:12.867504 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:12.868175 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:12.868601 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:12.868607 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:12.868610 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:12.868861 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:12.869483 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:12.869489 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:12.869877 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 06:56:12.870128 (+ 251us) client_negotiation.cc:240] Negotiation successful
0807 06:56:12.870536 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2162,"thread_start_us":1914,"threads_started":1}
I20260807 06:56:12.873126 23752 heartbeater.cc:347] Connected to a master server at 127.10.191.190:36275
I20260807 06:56:12.873440 23752 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:12.874188 23752 heartbeater.cc:511] Master 127.10.191.190:36275 requested a full tablet report, sending...
I20260807 06:56:12.875653 23139 ts_manager.cc:194] Registered new tserver with Master: 6a0440996bf6420786861586a62fcf5b (127.10.191.131:40189)
I20260807 06:56:12.876507 23139 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:39517
I20260807 06:56:12.881247 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab.
Entry for principal oryx/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab.
WARNING: no policy specified for oryx/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab.
Entry for principal oryx/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab.
WARNING: no policy specified for oryx/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab.
Entry for principal oryx/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab.
I20260807 06:56:13.068017 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 23223
Aug 07 06:56:13 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:56:13.084539 23766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:13.069355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38562 (local address 127.10.191.129:36853)
0807 06:56:13.070094 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:13.070101 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:13.070131 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:56:13.070200 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:13.070206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:13.070418 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:13.070568 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:13.072008 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:13.072989 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:13.074276 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:13.074864 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:13.074988 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:13.079246 (+ 4258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:13.079259 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:13.079273 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:13.079315 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:13.082047 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:13.082716 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:13.082724 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:13.082726 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:13.082858 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:13.083190 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:13.083193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:13.083195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:13.083557 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:13.083794 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:13.084030 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 06:56:13.084245 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":402,"threads_started":1}
I20260807 06:56:13.085990 23381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:13.168483 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 23223
I20260807 06:56:13.197774 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 23396
Aug 07 06:56:13 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:56:13.213943 23768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:13.198818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53592 (local address 127.10.191.130:38523)
0807 06:56:13.199398 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:13.199406 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:13.199432 (+ 26us) server_negotiation.cc:407] Connection header received
0807 06:56:13.199492 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:13.199498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:13.199706 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:13.199842 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:13.201002 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:13.201959 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:13.203092 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:13.203630 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:13.203727 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:13.208297 (+ 4570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:13.208312 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:13.208328 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:13.208365 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:13.211251 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:13.212005 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:13.212012 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:13.212014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:13.212163 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:13.212487 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:13.212490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:13.212492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:13.212843 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:13.213289 (+ 446us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:13.213423 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 06:56:13.213647 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":314,"threads_started":1}
I20260807 06:56:13.215307 23564 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:13.300097 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 23396
I20260807 06:56:13.325335 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 23576
Aug 07 06:56:13 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:56:13.341727 23772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:13.326400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42356 (local address 127.10.191.131:40189)
0807 06:56:13.326928 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:13.326934 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:13.326963 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:56:13.327025 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:13.327031 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:13.327248 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:13.327419 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:13.328842 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:13.329865 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:13.331068 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:13.331653 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:13.331811 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:13.336421 (+ 4610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:13.336432 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:13.336446 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:13.336478 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:13.339213 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:13.339828 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:13.339835 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:13.339837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:13.339950 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:13.340312 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:13.340315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:13.340317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:13.340660 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:13.340880 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:13.341219 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 06:56:13.341412 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":229,"threads_started":1}
I20260807 06:56:13.343077 23743 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:13.427115 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 23576
I20260807 06:56:13.449410 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 23102
I20260807 06:56:13.450786 23181 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:13.554719 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 23102
I20260807 06:56:13.584525 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36275
--webserver_interface=127.10.191.190
--webserver_port=38477
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:42433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:36275
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:13.940742 23775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:13.941172 23775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:13.941357 23775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:13.948570 23775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:56:13.948726 23775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:13.948828 23775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:13.948945 23775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:56:13.949040 23775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:56:13.959323 23775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:42433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:36275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=38477
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:13.960765 23775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:13.962162 23775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:13.974236 23781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:13.974309 23780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:13.974306 23783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:13.975319 23775 server_base.cc:1034] running on GCE node
I20260807 06:56:13.976155 23775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:13.977753 23775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:13.978993 23775 hybrid_clock.cc:648] HybridClock initialized: now 1786085773978954 us; error 64 us; skew 500 ppm
I20260807 06:56:13.979341 23775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:13 dist-test-slave-tfpf krb5kdc[23086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085773, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:13.982641 23775 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:56:13.984333 23775 webserver.cc:460] Webserver started at http://127.10.191.190:38477/ using document root <none> and password file <none>
I20260807 06:56:13.985248 23775 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:13.985431 23775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:13.991478 23775 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:56:13.994616 23792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:13.996091 23775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 06:56:13.996310 23775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "176f11a623b04fc49bc07e1db79119d1"
format_stamp: "Formatted at 2026-08-07 06:56:11 on dist-test-slave-tfpf"
server_key: "194127aa360bbc0bd12c7b521b64f02b"
server_key_iv: "4660943480d5dd87feff9ff1f2f7c491"
server_key_version: "encryptionkey@0"
I20260807 06:56:13.997452 23775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:14.024907 23775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:14.029749 23775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:14.030049 23775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:14.049744 23775 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:36275
I20260807 06:56:14.049765 23861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:36275 every 8 connection(s)
I20260807 06:56:14.051312 23775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:56:14.056370 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 23775
I20260807 06:56:14.057288 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:36853
--local_ip_for_outbound_sockets=127.10.191.129
--tserver_master_addrs=127.10.191.190:36275
--webserver_port=40007
--webserver_interface=127.10.191.129
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:42433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.191.129
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:56:14.058640 23862 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:56:14.062031 23862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: Bootstrap starting.
I20260807 06:56:14.084996 23862 log.cc:824] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:14.098269 23862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:56:14.098955 23862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: Bootstrap complete.
I20260807 06:56:14.113260 23862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } }
I20260807 06:56:14.114492 23862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176f11a623b04fc49bc07e1db79119d1, State: Initialized, Role: FOLLOWER
I20260807 06:56:14.115268 23862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } }
I20260807 06:56:14.115561 23862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:56:14.115692 23862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:56:14.115880 23862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:56:14.121802 23862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } }
I20260807 06:56:14.122498 23862 leader_election.cc:302] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 176f11a623b04fc49bc07e1db79119d1; no voters:
I20260807 06:56:14.123188 23862 leader_election.cc:288] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:56:14.123373 23867 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:56:14.124596 23867 raft_consensus.cc:686] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [term 2 LEADER]: Becoming Leader. State: Replica: 176f11a623b04fc49bc07e1db79119d1, State: Running, Role: LEADER
I20260807 06:56:14.125341 23867 consensus_queue.cc:237] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } }
I20260807 06:56:14.125631 23862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:56:14.128473 23869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 176f11a623b04fc49bc07e1db79119d1. Latest consensus state: current_term: 2 leader_uuid: "176f11a623b04fc49bc07e1db79119d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } } }
I20260807 06:56:14.128962 23869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:14.129609 23868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "176f11a623b04fc49bc07e1db79119d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176f11a623b04fc49bc07e1db79119d1" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36275 } } }
I20260807 06:56:14.129999 23868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:14.133723 23875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:56:14.141664 23875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:56:14.143375 23875 catalog_manager.cc:1259] Loaded cluster ID: f5d757ec4ab64ec39239137c6a53ded6
I20260807 06:56:14.143575 23875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:56:14.147692 23875 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:56:14.149638 23875 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 176f11a623b04fc49bc07e1db79119d1: Loaded TSK: 0
I20260807 06:56:14.151194 23875 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:56:14.440687 23865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:14.441022 23865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:14.441215 23865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:14.448128 23865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:14.448292 23865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:14.448457 23865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:56:14.458142 23865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:42433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.129.keytab
--principal=oryx/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:36853
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=40007
--tserver_master_addrs=127.10.191.190:36275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:14.459578 23865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:14.460958 23865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:14.476181 23902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:14.476042 23897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:14.476656 23896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:14.478420 23865 server_base.cc:1034] running on GCE node
I20260807 06:56:14.479108 23865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:14.480126 23865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:14.481370 23865 hybrid_clock.cc:648] HybridClock initialized: now 1786085774481310 us; error 52 us; skew 500 ppm
I20260807 06:56:14.481750 23865 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:14 dist-test-slave-tfpf krb5kdc[23086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085774, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:14.485569 23865 init.cc:377] Logged in from keytab as oryx/127.10.191.129@KRBTEST.COM (short username oryx)
I20260807 06:56:14.487314 23865 webserver.cc:460] Webserver started at http://127.10.191.129:40007/ using document root <none> and password file <none>
I20260807 06:56:14.488081 23865 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:14.488226 23865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:14.493798 23865 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:56:14.496659 23909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:14.498229 23865 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:56:14.498409 23865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "fec0dc861031465a96d0b5c14c6289b1"
format_stamp: "Formatted at 2026-08-07 06:56:11 on dist-test-slave-tfpf"
server_key: "8a75dc39ff9c070b61202255652758ca"
server_key_iv: "c09d12a62135788afe2e28053685c275"
server_key_version: "encryptionkey@0"
I20260807 06:56:14.499379 23865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:14.524922 23865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:14.529358 23865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:14.529672 23865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:14.530735 23865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:14.532099 23865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:14.532234 23865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:14.532361 23865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:14.532447 23865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:14.566661 23865 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:36853
I20260807 06:56:14.566716 24058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:36853 every 8 connection(s)
I20260807 06:56:14.568235 23865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:56:14.576610 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 23865
I20260807 06:56:14.577376 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:38523
--local_ip_for_outbound_sockets=127.10.191.130
--tserver_master_addrs=127.10.191.190:36275
--webserver_port=37027
--webserver_interface=127.10.191.130
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:42433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.191.130
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:56:14 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:14 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 06:56:14.587859 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:14.571420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:42919 (local address 127.10.191.190:36275)
0807 06:56:14.572279 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:14.572294 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:14.572559 (+ 265us) server_negotiation.cc:407] Connection header received
0807 06:56:14.574834 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:14.574846 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:14.575189 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:14.575563 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:14.577318 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.578594 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.580143 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.580770 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.580978 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:14.586845 (+ 5867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:42919: BlockingRecv error: recv got EOF from 127.10.191.129:42919 (error 108)
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":309,"threads_started":1}
I20260807 06:56:14.587860 24062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:14.571522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:42919)
0807 06:56:14.572378 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:14.572428 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:14.574265 (+ 1837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:14.575707 (+ 1442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:14.575721 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:14.576419 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:14.577052 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:14.577131 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.578793 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.578799 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:14.579991 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:14.580004 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.581009 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.581016 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:14.581312 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:14.581989 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:14.582011 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:14.586533 (+ 4522us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":351,"threads_started":1}
W20260807 06:56:14.588532 24059 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:36275 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.191.190:36275: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Aug 07 06:56:14 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:14 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:14.597800 24062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:14.589280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:34067)
0807 06:56:14.589487 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:14.589509 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:14.589646 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:14.589978 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:14.589985 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:14.590399 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:14.590542 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:14.590551 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.592095 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.592100 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:14.593031 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:14.593043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.594084 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.594088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:14.594205 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:14.594807 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:14.594823 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:14.597602 (+ 2779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 06:56:14.598127 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:14.589383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:34067 (local address 127.10.191.190:36275)
0807 06:56:14.589531 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:14.589535 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:14.589554 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:56:14.589783 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:14.589786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:14.589842 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:14.589919 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:14.590690 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.591903 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.593248 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.593945 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.594084 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:14.597872 (+ 3788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:34067: BlockingRecv error: recv got EOF from 127.10.191.129:34067 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 06:56:14 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:14 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:14.607995 24064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:14.598543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:35471)
0807 06:56:14.599442 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:14.599456 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:14.599555 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:14.599899 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:14.599902 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:14.600320 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:14.600529 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:14.600537 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.601718 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.601730 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:14.602930 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:14.602943 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.603700 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.603707 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:14.603870 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:14.604641 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:14.604659 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:14.607655 (+ 2996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":540,"threads_started":1}
W20260807 06:56:14.608143 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:14.598622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:35471 (local address 127.10.191.190:36275)
0807 06:56:14.598787 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:14.598794 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:14.599558 (+ 764us) server_negotiation.cc:407] Connection header received
0807 06:56:14.599668 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:14.599674 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:14.599768 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:14.599870 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:14.600676 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.601572 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.603083 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:14.603515 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:14.603656 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:14.607897 (+ 4241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:35471: BlockingRecv error: recv got EOF from 127.10.191.129:35471 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 06:56:14.608354 24059 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:56:14.933357 24063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:14.933696 24063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:14.933871 24063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:14.941085 24063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:14.941294 24063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:14.941469 24063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:56:14.951198 24063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:42433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.130.keytab
--principal=oryx/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:38523
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=37027
--tserver_master_addrs=127.10.191.190:36275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:14.952641 24063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:14.954005 24063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:14.968091 24071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:14.968004 24073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:14.968035 24075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:14.969498 24063 server_base.cc:1034] running on GCE node
I20260807 06:56:14.970345 24063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:14.971581 24063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:14.972849 24063 hybrid_clock.cc:648] HybridClock initialized: now 1786085774972802 us; error 29 us; skew 500 ppm
I20260807 06:56:14.973276 24063 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:14 dist-test-slave-tfpf krb5kdc[23086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085774, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:14.976995 24063 init.cc:377] Logged in from keytab as oryx/127.10.191.130@KRBTEST.COM (short username oryx)
I20260807 06:56:14.978493 24063 webserver.cc:460] Webserver started at http://127.10.191.130:37027/ using document root <none> and password file <none>
I20260807 06:56:14.979218 24063 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:14.979379 24063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:14.984866 24063 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 06:56:14.987830 24083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:14.989252 24063 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:56:14.989449 24063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "09c6c0e1412f47cc9df9a97beff65e4a"
format_stamp: "Formatted at 2026-08-07 06:56:12 on dist-test-slave-tfpf"
server_key: "64fb0f8affa7a0ce3043f22a935e79e3"
server_key_iv: "45626b83579119b5e20e22bfb175cc76"
server_key_version: "encryptionkey@0"
I20260807 06:56:14.990449 24063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:15.012686 24063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:15.017572 24063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:15.017884 24063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:15.018908 24063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:15.020275 24063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:15.020397 24063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:15.020532 24063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:15.020617 24063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:15.055119 24063 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:38523
I20260807 06:56:15.055200 24221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:38523 every 8 connection(s)
I20260807 06:56:15.056739 24063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:56:15.063752 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 24063
I20260807 06:56:15.064374 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:40189
--local_ip_for_outbound_sockets=127.10.191.131
--tserver_master_addrs=127.10.191.190:36275
--webserver_port=45669
--webserver_interface=127.10.191.131
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:42433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.191.131
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 06:56:15.074611 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:15.059658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:44553 (local address 127.10.191.190:36275)
0807 06:56:15.059953 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:15.059960 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:15.061321 (+ 1361us) server_negotiation.cc:407] Connection header received
0807 06:56:15.063169 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:15.063173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:15.063234 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:15.063386 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:15.065043 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.066293 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.067881 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.068537 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.068689 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.074409 (+ 5720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:44553: BlockingRecv error: recv got EOF from 127.10.191.130:44553 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
I20260807 06:56:15.075680 24224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:15.060151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:44553)
0807 06:56:15.061020 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:15.061154 (+ 134us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:15.062920 (+ 1766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:15.063602 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:15.063610 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:15.064185 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:15.064856 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.064875 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.066481 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.066485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.067692 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.067704 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.068770 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.068775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.068978 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.069753 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:15.069781 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:15.074236 (+ 4455us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":361,"threads_started":1}
W20260807 06:56:15.076437 24222 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:36275 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.191.190:36275: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:15.085239 24224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:15.077044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:58455)
0807 06:56:15.077314 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:15.077336 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:15.077455 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:15.077815 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:15.077820 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:15.078160 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:15.078303 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.078310 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.079369 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.079381 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.080244 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.080255 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.080946 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.080951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.081160 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.081762 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:15.081778 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:15.084882 (+ 3104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111}
W20260807 06:56:15.085433 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:15.077328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:58455 (local address 127.10.191.190:36275)
0807 06:56:15.077536 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:15.077543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:15.077561 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:56:15.077618 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:15.077621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:15.077677 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:15.077785 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:15.078452 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.079224 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.080387 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.080796 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.080931 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.085191 (+ 4260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:58455: BlockingRecv error: recv got EOF from 127.10.191.130:58455 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:15.094470 24224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:15.086157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:58959)
0807 06:56:15.086334 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:15.086372 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:15.086454 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:15.086818 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:15.086821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:15.087098 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:15.087240 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.087248 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.088655 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.088659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.089589 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.089601 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.090639 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.090643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.090759 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.091372 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:15.091387 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:15.094206 (+ 2819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 06:56:15.094766 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:15.086293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:58959 (local address 127.10.191.190:36275)
0807 06:56:15.086495 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:15.086503 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:15.086525 (+ 22us) server_negotiation.cc:407] Connection header received
0807 06:56:15.086587 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:15.086595 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:15.086677 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:15.086789 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:15.087391 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.088509 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.089737 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.090496 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.090650 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.094497 (+ 3847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:58959: BlockingRecv error: recv got EOF from 127.10.191.130:58959 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 06:56:15.094901 24222 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:56:15.411737 24226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:15.412039 24226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:15.412213 24226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:15.419593 24226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:15.419713 24226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:15.419848 24226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:56:15.430063 24226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:42433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/krb5kdc/oryx_127.10.191.131.keytab
--principal=oryx/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:40189
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=45669
--tserver_master_addrs=127.10.191.190:36275
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:15.431413 24226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:15.432696 24226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:15.446733 24236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:15.446771 24237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:15.446686 24239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:15.448050 24226 server_base.cc:1034] running on GCE node
I20260807 06:56:15.448678 24226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:15.449659 24226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:15.450860 24226 hybrid_clock.cc:648] HybridClock initialized: now 1786085775450814 us; error 54 us; skew 500 ppm
I20260807 06:56:15.451175 24226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085775, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:15.454353 24226 init.cc:377] Logged in from keytab as oryx/127.10.191.131@KRBTEST.COM (short username oryx)
I20260807 06:56:15.455787 24226 webserver.cc:460] Webserver started at http://127.10.191.131:45669/ using document root <none> and password file <none>
I20260807 06:56:15.456498 24226 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:15.456668 24226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:15.461869 24226 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:56:15.464344 24247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:15.465552 24226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:56:15.465732 24226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "6a0440996bf6420786861586a62fcf5b"
format_stamp: "Formatted at 2026-08-07 06:56:12 on dist-test-slave-tfpf"
server_key: "c3eb9ebc4c00b52cb7931d2a1a713d22"
server_key_iv: "118156ae39a9e2420f5143be1eb9be69"
server_key_version: "encryptionkey@0"
I20260807 06:56:15.466686 24226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:15.480873 24226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:15.484921 24226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:15.485249 24226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:15.486178 24226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:15.487433 24226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:15.487561 24226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:15.487684 24226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:15.487767 24226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:15.521042 24226 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:40189
I20260807 06:56:15.521188 24397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:40189 every 8 connection(s)
I20260807 06:56:15.522675 24226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:56:15.529605 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 24226
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 06:56:15.540581 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:15.525317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:59157 (local address 127.10.191.190:36275)
0807 06:56:15.525566 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:15.525573 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:15.526927 (+ 1354us) server_negotiation.cc:407] Connection header received
0807 06:56:15.528792 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:15.528797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:15.528869 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:15.528959 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:15.531017 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.531922 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.533986 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.534421 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.534512 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.540251 (+ 5739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:59157: BlockingRecv error: recv got EOF from 127.10.191.131:59157 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 06:56:15.541623 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:15.525942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:59157)
0807 06:56:15.526754 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:15.526801 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:15.528529 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:15.529295 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:15.529308 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:15.530090 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:15.530774 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.530799 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.532148 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.532152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.533812 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.533828 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.534687 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.534694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.535040 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.535987 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:15.536034 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:15.540063 (+ 4029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":285,"threads_started":1}
W20260807 06:56:15.542429 24399 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:36275 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.191.190:36275: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
I20260807 06:56:15.547036 24403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:15.530761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46012 (local address 127.10.191.190:36275)
0807 06:56:15.531544 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:15.531549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:15.531573 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:56:15.531611 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:15.531615 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:15.531665 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:15.531779 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:15.533540 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.534462 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.536131 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.536821 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.536962 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.539529 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:15.539539 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:15.539561 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:15.539605 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:15.543375 (+ 3770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:15.544187 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:15.544194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:15.544200 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:15.544477 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:15.544876 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:15.544887 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:15.544890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:15.545568 (+ 678us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:15.545824 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:15.546332 (+ 508us) server_negotiation.cc:299] Negotiation successful
0807 06:56:15.546640 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":508,"threads_started":1}
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:15.551748 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:15.543071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:55975)
0807 06:56:15.543241 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:15.543256 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:15.543332 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:15.543668 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:15.543676 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:15.544061 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:15.544238 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.544247 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.545681 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.545687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.546989 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.547002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.547861 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.547867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.548028 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.548658 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:15.548675 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:15.551547 (+ 2872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 06:56:15.551926 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:15.543166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:55975 (local address 127.10.191.190:36275)
0807 06:56:15.543350 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:15.543356 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:15.543377 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:56:15.543428 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:15.543433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:15.543522 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:15.543616 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:15.544407 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.545490 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.547128 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.547708 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.547802 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.551708 (+ 3906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:55975: BlockingRecv error: recv got EOF from 127.10.191.131:55975 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:15.559134 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:15.552399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:41103)
0807 06:56:15.552549 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:15.552572 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:15.552642 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:15.552908 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:15.552910 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:15.553226 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:15.553362 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.553369 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.554226 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.554229 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.555088 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.555099 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.555741 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.555745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.555891 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.556425 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:15.556440 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:15.558935 (+ 2495us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 06:56:15.559342 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:15.552504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:41103 (local address 127.10.191.190:36275)
0807 06:56:15.552701 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:15.552705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:15.552718 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:56:15.552754 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:15.552757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:15.552803 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:15.552875 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:15.553474 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.554109 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.555225 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.555625 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.555723 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.559120 (+ 3397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:41103: BlockingRecv error: recv got EOF from 127.10.191.131:41103 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
W20260807 06:56:15.559475 24399 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:15 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:15.618722 24405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:15.609183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:47879)
0807 06:56:15.609690 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:15.609706 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:15.609830 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:15.610204 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:15.610208 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:15.610680 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:15.610866 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.610875 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.612392 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.612398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.613557 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:15.613571 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.614436 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.614443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:15.614652 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.615415 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:15.615433 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:15.618475 (+ 3042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":304,"threads_started":1}
W20260807 06:56:15.618973 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:15.609232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:47879 (local address 127.10.191.190:36275)
0807 06:56:15.609456 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:15.609464 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:15.609790 (+ 326us) server_negotiation.cc:407] Connection header received
0807 06:56:15.609934 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:15.609937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:15.610067 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:15.610154 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:15.611028 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.612188 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.613715 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:15.614227 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:15.614394 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:15.618713 (+ 4319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:47879: BlockingRecv error: recv got EOF from 127.10.191.129:47879 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 06:56:16 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:16 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:16.104892 24406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:16.095503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:33241)
0807 06:56:16.096059 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:16.096076 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:16.096260 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:16.096634 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:16.096639 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:16.097275 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:16.097479 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:16.097488 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.098532 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.098539 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:16.099497 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:16.099510 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.100285 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.100291 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:16.100457 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:16.101130 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:16.101147 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:16.104555 (+ 3408us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":296,"threads_started":1}
W20260807 06:56:16.105041 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:16.095571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:33241 (local address 127.10.191.190:36275)
0807 06:56:16.095850 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:16.095857 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:16.096175 (+ 318us) server_negotiation.cc:407] Connection header received
0807 06:56:16.096396 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:16.096415 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:16.096483 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:16.096600 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:16.097629 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.098383 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.099651 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.100096 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.100228 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:16.104780 (+ 4552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:33241: BlockingRecv error: recv got EOF from 127.10.191.130:33241 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 06:56:16 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:16 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:16.568665 24407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:16.560059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:49527)
0807 06:56:16.560544 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:16.560560 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:16.560678 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:16.560977 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:16.560981 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:16.561481 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:16.561678 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:16.561688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.562620 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.562623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:16.563550 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:16.563562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.564208 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.564212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:16.564331 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:16.564959 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:16.564977 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:16.568325 (+ 3348us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":270,"threads_started":1}
W20260807 06:56:16.568821 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:16.560115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:49527 (local address 127.10.191.190:36275)
0807 06:56:16.560345 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:16.560352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:16.560661 (+ 309us) server_negotiation.cc:407] Connection header received
0807 06:56:16.560779 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:16.560783 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:16.560845 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:16.560926 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:16.561804 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.562488 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.563680 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.564057 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.564157 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:16.568571 (+ 4414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:49527: BlockingRecv error: recv got EOF from 127.10.191.131:49527 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 06:56:16 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:16 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:16.628567 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:16.619739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:58241)
0807 06:56:16.620288 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:16.620305 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:16.620468 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:16.620861 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:16.620867 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:16.621391 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:16.621556 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:16.621565 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.622617 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.622624 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:16.623535 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:16.623550 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.624308 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.624314 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:16.624484 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:16.625185 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:16.625204 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:16.628226 (+ 3022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":296,"threads_started":1}
W20260807 06:56:16.628713 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:16.619824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:58241 (local address 127.10.191.190:36275)
0807 06:56:16.620048 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:16.620056 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:16.620402 (+ 346us) server_negotiation.cc:407] Connection header received
0807 06:56:16.620613 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:16.620617 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:16.620698 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:16.620822 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:16.621729 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.622449 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.623699 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:16.624144 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:16.624282 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:16.628441 (+ 4159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:58241: BlockingRecv error: recv got EOF from 127.10.191.129:58241 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 06:56:17 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:17 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:17.114413 24409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:17.105871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:38343)
0807 06:56:17.106482 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:17.106527 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:17.106685 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:17.107117 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:17.107122 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:17.107705 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:17.107912 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:17.107925 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.108985 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.108988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:17.110003 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:17.110016 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.110673 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.110677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:17.110790 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:17.111347 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:17.111365 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:17.114184 (+ 2819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":350,"threads_started":1}
W20260807 06:56:17.114583 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:17.105979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:38343 (local address 127.10.191.190:36275)
0807 06:56:17.106185 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:17.106192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:17.106626 (+ 434us) server_negotiation.cc:407] Connection header received
0807 06:56:17.106827 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:17.106832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:17.106934 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:17.107016 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:17.108098 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.108863 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.110150 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.110540 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.110632 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:17.114376 (+ 3744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:38343: BlockingRecv error: recv got EOF from 127.10.191.130:38343 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 06:56:17 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:17 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:17.578836 24410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:17.569888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:50547)
0807 06:56:17.570524 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:17.570541 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:17.570667 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:17.570981 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:17.570999 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:17.571401 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:17.571671 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:17.571686 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.572714 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.572718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:17.573634 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:17.573647 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.574330 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.574334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:17.574451 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:17.575101 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:17.575119 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:17.578590 (+ 3471us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":340,"threads_started":1}
W20260807 06:56:17.579001 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:17.570109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:50547 (local address 127.10.191.190:36275)
0807 06:56:17.570332 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:17.570338 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:17.570620 (+ 282us) server_negotiation.cc:407] Connection header received
0807 06:56:17.570776 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:17.570780 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:17.570842 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:17.570936 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:17.571833 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.572584 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.573764 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.574179 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.574290 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:17.578780 (+ 4490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:50547: BlockingRecv error: recv got EOF from 127.10.191.131:50547 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 07 06:56:17 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:17 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:17.637601 24411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:17.629726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:43185)
0807 06:56:17.630190 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:17.630205 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:17.630320 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:17.630598 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:17.630601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:17.630937 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:17.631129 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:17.631138 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.632065 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.632068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:17.632934 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:17.632945 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.633601 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.633605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:17.633722 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:17.634380 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:17.634399 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:17.637246 (+ 2847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":253,"threads_started":1}
W20260807 06:56:17.637656 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:17.629827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:43185 (local address 127.10.191.190:36275)
0807 06:56:17.630094 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:17.630100 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:17.630282 (+ 182us) server_negotiation.cc:407] Connection header received
0807 06:56:17.630405 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:17.630408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:17.630472 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:17.630550 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:17.631257 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.631945 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.633048 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:17.633476 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:17.633563 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:17.637402 (+ 3839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:43185: BlockingRecv error: recv got EOF from 127.10.191.129:43185 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 07 06:56:18 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:18 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:18.124440 24412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:18.115381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:59115)
0807 06:56:18.115922 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:18.115938 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:18.116107 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:18.116466 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:18.116472 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:18.116893 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:18.117137 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:18.117148 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.118271 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.118276 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:18.119227 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:18.119240 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.120006 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.120014 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:18.120217 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:18.120953 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:18.120973 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:18.124066 (+ 3093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":286,"threads_started":1}
W20260807 06:56:18.124579 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:18.115503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:59115 (local address 127.10.191.190:36275)
0807 06:56:18.115749 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:18.115756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:18.116031 (+ 275us) server_negotiation.cc:407] Connection header received
0807 06:56:18.116240 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:18.116247 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:18.116317 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:18.116425 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:18.117298 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.118098 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.119387 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.119831 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.119974 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:18.124319 (+ 4345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:59115: BlockingRecv error: recv got EOF from 127.10.191.130:59115 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 07 06:56:18 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:18 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:18.588732 24413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:18.580026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:56671)
0807 06:56:18.580590 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:18.580606 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:18.580730 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:18.581039 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:18.581042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:18.581489 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:18.581670 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:18.581679 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.582883 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.582887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:18.584062 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:18.584076 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.584737 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.584741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:18.584863 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:18.585584 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:18.585602 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:18.588468 (+ 2866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":330,"threads_started":1}
W20260807 06:56:18.588917 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:18.580140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:56671 (local address 127.10.191.190:36275)
0807 06:56:18.580339 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:18.580343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:18.580688 (+ 345us) server_negotiation.cc:407] Connection header received
0807 06:56:18.580836 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:18.580839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:18.580903 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:18.580993 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:18.581841 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.582742 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.584193 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.584611 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.584707 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:18.588682 (+ 3975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:56671: BlockingRecv error: recv got EOF from 127.10.191.131:56671 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 06:56:18 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:18 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:18.647730 24415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:18.638817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:56621)
0807 06:56:18.639367 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:18.639383 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:18.639504 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:18.639811 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:18.639814 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:18.640227 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:18.640390 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:18.640399 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.641410 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.641414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:18.642358 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:18.642369 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.643022 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.643026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:18.643140 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:18.643925 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:18.643944 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:18.647232 (+ 3288us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":302,"threads_started":1}
W20260807 06:56:18.647744 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:18.638902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:56621 (local address 127.10.191.190:36275)
0807 06:56:18.639119 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:18.639123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:18.639461 (+ 338us) server_negotiation.cc:407] Connection header received
0807 06:56:18.639607 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:18.639610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:18.639680 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:18.639765 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:18.640532 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.641274 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.642485 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:18.642899 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:18.642995 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:18.647528 (+ 4533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:56621: BlockingRecv error: recv got EOF from 127.10.191.129:56621 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 07 06:56:19 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:19 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:19.139214 24416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:19.125885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:59551)
0807 06:56:19.126557 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:19.126574 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:19.126700 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:19.127080 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:19.127084 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:19.127574 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:19.127805 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:19.127818 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.129018 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.129025 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:19.130204 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:19.130217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.130857 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.130861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:19.130976 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:19.135966 (+ 4990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:19.135987 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:19.138959 (+ 2972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":458,"threads_started":1}
W20260807 06:56:19.139449 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:19.126066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:59551 (local address 127.10.191.190:36275)
0807 06:56:19.126252 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:19.126257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:19.126680 (+ 423us) server_negotiation.cc:407] Connection header received
0807 06:56:19.126825 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:19.126829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:19.126897 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:19.126984 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:19.127974 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.128870 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.130333 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.130736 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.130833 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:19.139211 (+ 8378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:59551: BlockingRecv error: recv got EOF from 127.10.191.130:59551 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 06:56:19 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:19 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:19.598109 24417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:19.589717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:41097)
0807 06:56:19.590205 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:19.590222 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:19.590340 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:19.590622 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:19.590625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:19.591015 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:19.591171 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:19.591179 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.592195 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.592198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:19.593194 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:19.593208 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.594041 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.594047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:19.594183 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:19.594876 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:19.594895 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:19.597760 (+ 2865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":276,"threads_started":1}
W20260807 06:56:19.598245 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:19.589822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:41097 (local address 127.10.191.190:36275)
0807 06:56:19.590093 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:19.590099 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:19.590318 (+ 219us) server_negotiation.cc:407] Connection header received
0807 06:56:19.590440 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:19.590443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:19.590505 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:19.590585 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:19.591297 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.592065 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.593386 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.593856 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.593954 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:19.597988 (+ 4034us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:41097: BlockingRecv error: recv got EOF from 127.10.191.131:41097 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
Aug 07 06:56:19 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:19 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:19.658315 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:19.649120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:45127)
0807 06:56:19.649881 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:19.649904 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:19.650083 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:19.650454 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:19.650459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:19.650933 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:19.651102 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:19.651111 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.652257 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.652263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:19.653229 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:19.653242 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.653980 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.653986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:19.654179 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:19.654774 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:19.654791 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:19.657915 (+ 3124us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":436,"threads_started":1}
W20260807 06:56:19.658401 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:19.649272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:45127 (local address 127.10.191.190:36275)
0807 06:56:19.649506 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:19.649515 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:19.650018 (+ 503us) server_negotiation.cc:407] Connection header received
0807 06:56:19.650243 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:19.650247 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:19.650311 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:19.650417 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:19.651308 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.652084 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.653389 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:19.653805 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:19.653959 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:19.658163 (+ 4204us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:45127: BlockingRecv error: recv got EOF from 127.10.191.129:45127 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 06:56:20 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:20 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:20.149035 24423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:20.140362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:44017)
0807 06:56:20.140987 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:20.141004 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:20.141153 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:20.141483 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:20.141486 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:20.141909 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:20.142078 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:20.142087 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.143379 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.143387 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:20.144292 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:20.144305 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.145047 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.145053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:20.145270 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:20.145902 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:20.145920 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:20.148678 (+ 2758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":293,"threads_started":1}
W20260807 06:56:20.149197 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:20.140619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:44017 (local address 127.10.191.190:36275)
0807 06:56:20.140847 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:20.140854 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:20.141089 (+ 235us) server_negotiation.cc:407] Connection header received
0807 06:56:20.141280 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:20.141284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:20.141349 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:20.141435 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:20.142251 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.143228 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.144452 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.144881 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.145019 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:20.148891 (+ 3872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:44017: BlockingRecv error: recv got EOF from 127.10.191.130:44017 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 07 06:56:20 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:20 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:20.607508 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:20.599143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:34815)
0807 06:56:20.599717 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:20.599734 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:20.599851 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:20.600142 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:20.600145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:20.600582 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:20.600781 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:20.600791 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.601936 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.601940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:20.602990 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:20.603004 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.603703 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.603708 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:20.603878 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:20.604454 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:20.604473 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:20.607251 (+ 2778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":288,"threads_started":1}
W20260807 06:56:20.607717 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:20.599185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:34815 (local address 127.10.191.190:36275)
0807 06:56:20.599362 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:20.599366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:20.599807 (+ 441us) server_negotiation.cc:407] Connection header received
0807 06:56:20.599937 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:20.599940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:20.600002 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:20.600094 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:20.600920 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.601803 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.603129 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.603550 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.603653 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:20.607456 (+ 3803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:34815: BlockingRecv error: recv got EOF from 127.10.191.131:34815 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 06:56:20 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:20 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:20.667980 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:20.659632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:44369)
0807 06:56:20.660166 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:20.660183 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:20.660304 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:20.660614 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:20.660618 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:20.661021 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:20.661237 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:20.661247 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.662288 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.662291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:20.663205 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:20.663216 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.663924 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.663928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:20.664059 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:20.664718 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:20.664738 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:20.667740 (+ 3002us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":282,"threads_started":1}
W20260807 06:56:20.668298 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:20.659692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:44369 (local address 127.10.191.190:36275)
0807 06:56:20.659947 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:20.659956 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:20.660267 (+ 311us) server_negotiation.cc:407] Connection header received
0807 06:56:20.660405 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:20.660408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:20.660475 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:20.660566 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:20.661381 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.662160 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.663344 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:20.663785 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:20.663880 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:20.667967 (+ 4087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:44369: BlockingRecv error: recv got EOF from 127.10.191.129:44369 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 06:56:21 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:21 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:21.159296 24427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:21.150308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:41017)
0807 06:56:21.151050 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:21.151088 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:21.151245 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:21.151627 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:21.151632 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:21.152144 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:21.152316 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:21.152325 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.153420 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.153427 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:21.154340 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:21.154352 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.155107 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.155114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:21.155285 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:21.155959 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:21.155978 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:21.159076 (+ 3098us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":436,"threads_started":1}
W20260807 06:56:21.159588 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:21.150611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:41017 (local address 127.10.191.190:36275)
0807 06:56:21.150850 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:21.150856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:21.151185 (+ 329us) server_negotiation.cc:407] Connection header received
0807 06:56:21.151403 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:21.151414 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:21.151477 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:21.151599 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:21.152461 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.153273 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.154486 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.154931 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.155063 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:21.159301 (+ 4238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:41017: BlockingRecv error: recv got EOF from 127.10.191.130:41017 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 07 06:56:21 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:21 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:21.617101 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:21.608519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:49587)
0807 06:56:21.609035 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:21.609050 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:21.609231 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:21.609547 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:21.609551 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:21.609964 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:21.610119 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:21.610128 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.611218 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.611222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:21.612108 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:21.612120 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.612900 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.612906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:21.613114 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:21.613860 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:21.613879 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:21.616821 (+ 2942us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":287,"threads_started":1}
W20260807 06:56:21.617344 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:21.608568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:49587 (local address 127.10.191.190:36275)
0807 06:56:21.608781 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:21.608789 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:21.609157 (+ 368us) server_negotiation.cc:407] Connection header received
0807 06:56:21.609355 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:21.609359 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:21.609418 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:21.609515 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:21.610275 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.611051 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.612282 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.612727 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.612854 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:21.617034 (+ 4180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:49587: BlockingRecv error: recv got EOF from 127.10.191.131:49587 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 06:56:21 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:21 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:21.677745 24429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:21.669157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:41095)
0807 06:56:21.669838 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:21.669855 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:21.669976 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:21.670390 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:21.670396 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:21.670888 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:21.671064 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:21.671074 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.672111 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.672117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:21.672985 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:21.672997 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.673828 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.673834 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:21.674019 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:21.674571 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:21.674589 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:21.677475 (+ 2886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":315,"threads_started":1}
W20260807 06:56:21.677934 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:21.669237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:41095 (local address 127.10.191.190:36275)
0807 06:56:21.669449 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:21.669453 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:21.669931 (+ 478us) server_negotiation.cc:407] Connection header received
0807 06:56:21.670089 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:21.670092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:21.670176 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:21.670344 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:21.671226 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.671953 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.673226 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:21.673653 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:21.673801 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:21.677682 (+ 3881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:41095: BlockingRecv error: recv got EOF from 127.10.191.129:41095 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 06:56:22 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:22 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:22.169027 24430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:22.160223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:39769)
0807 06:56:22.160878 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:22.160894 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:22.161010 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:22.161352 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:22.161355 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:22.161877 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:22.162145 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:22.162161 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.163393 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.163397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:22.164352 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:22.164365 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.165010 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.165014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:22.165214 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:22.165882 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:22.165900 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:22.168763 (+ 2863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":323,"threads_started":1}
W20260807 06:56:22.169245 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:22.160318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:39769 (local address 127.10.191.190:36275)
0807 06:56:22.160536 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:22.160541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:22.160968 (+ 427us) server_negotiation.cc:407] Connection header received
0807 06:56:22.161149 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:22.161152 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:22.161215 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:22.161302 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:22.162311 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.163246 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.164476 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.164876 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.164968 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:22.168968 (+ 4000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:39769: BlockingRecv error: recv got EOF from 127.10.191.130:39769 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 07 06:56:22 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:22 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:22.626926 24431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:22.618214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:56035)
0807 06:56:22.618809 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:22.618825 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:22.618952 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:22.619361 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:22.619369 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:22.619767 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:22.619930 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:22.619938 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.620815 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.620818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:22.621713 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:22.621724 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.622584 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.622589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:22.622759 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:22.623394 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:22.623432 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:22.626541 (+ 3109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":287,"threads_started":1}
W20260807 06:56:22.627036 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:22.618316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:56035 (local address 127.10.191.190:36275)
0807 06:56:22.618491 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:22.618495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:22.618896 (+ 401us) server_negotiation.cc:407] Connection header received
0807 06:56:22.619044 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:22.619048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:22.619127 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:22.619245 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:22.620052 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.620700 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.621848 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.622394 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.622554 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:22.626772 (+ 4218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:56035: BlockingRecv error: recv got EOF from 127.10.191.131:56035 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 06:56:22 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:22 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:22.687242 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:22.678801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:41267)
0807 06:56:22.679375 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:22.679392 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:22.679517 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:22.679880 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:22.679883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:22.680306 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:22.680458 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:22.680466 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.681489 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.681492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:22.682381 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:22.682392 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.683084 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.683088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:22.683200 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:22.683859 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:22.683877 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:22.686994 (+ 3117us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":297,"threads_started":1}
W20260807 06:56:22.687467 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:22.679005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:41267 (local address 127.10.191.190:36275)
0807 06:56:22.679229 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:22.679235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:22.679473 (+ 238us) server_negotiation.cc:407] Connection header received
0807 06:56:22.679659 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:22.679662 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:22.679735 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:22.679821 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:22.680577 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.681364 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.682495 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:22.682931 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:22.683022 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:22.687203 (+ 4181us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:41267: BlockingRecv error: recv got EOF from 127.10.191.129:41267 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 06:56:23 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:23 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:23.178910 24434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:23.170248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:57389)
0807 06:56:23.170765 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:23.170782 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:23.170931 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:23.171228 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:23.171231 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:23.171637 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:23.171792 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:23.171800 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.172949 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.172952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:23.173903 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:23.173915 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.174607 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.174611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:23.174727 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:23.175302 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:23.175318 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:23.178655 (+ 3337us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":274,"threads_started":1}
W20260807 06:56:23.179164 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:23.170308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:57389 (local address 127.10.191.190:36275)
0807 06:56:23.170537 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:23.170546 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:23.170881 (+ 335us) server_negotiation.cc:407] Connection header received
0807 06:56:23.171034 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:23.171037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:23.171099 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:23.171180 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:23.171914 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.172822 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.174025 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.174427 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.174536 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:23.178905 (+ 4369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:57389: BlockingRecv error: recv got EOF from 127.10.191.130:57389 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 06:56:23 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:23 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:23.637588 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:23.627982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:38917)
0807 06:56:23.628592 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:23.628609 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:23.628751 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:23.629130 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:23.629137 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:23.629599 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:23.629778 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:23.629787 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.630851 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.630854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:23.631921 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:23.631940 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.633014 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.633021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:23.633252 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:23.634018 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:23.634045 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:23.637334 (+ 3289us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":331,"threads_started":1}
W20260807 06:56:23.637844 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:23.628128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:38917 (local address 127.10.191.190:36275)
0807 06:56:23.628324 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:23.628329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:23.628686 (+ 357us) server_negotiation.cc:407] Connection header received
0807 06:56:23.628875 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:23.628879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:23.628955 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:23.629030 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:23.629929 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.630697 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.632136 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.632765 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.632912 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:23.637543 (+ 4631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:38917: BlockingRecv error: recv got EOF from 127.10.191.131:38917 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 06:56:23 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:23 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:23.697297 24436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:23.688141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:56475)
0807 06:56:23.688777 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:23.688799 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:23.688923 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:23.689333 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:23.689338 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:23.689798 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:23.689964 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:23.689973 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.690988 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.690999 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:23.691908 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:23.691919 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.692612 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.692619 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:23.692777 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:23.693469 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:23.693487 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:23.696894 (+ 3407us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":336,"threads_started":1}
W20260807 06:56:23.697395 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:23.688202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:56475 (local address 127.10.191.190:36275)
0807 06:56:23.688423 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:23.688431 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:23.688881 (+ 450us) server_negotiation.cc:407] Connection header received
0807 06:56:23.689025 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:23.689029 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:23.689178 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:23.689302 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:23.690114 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.690843 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.692040 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:23.692452 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:23.692580 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:23.697157 (+ 4577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:56475: BlockingRecv error: recv got EOF from 127.10.191.129:56475 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 06:56:24 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:24 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:24.193351 24437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:24.180084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:35219)
0807 06:56:24.180713 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:24.180731 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:24.180854 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:24.181289 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:24.181295 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:24.181723 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:24.181891 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:24.181899 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.183229 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.183233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:24.184145 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:24.184158 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.184839 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.184843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:24.184967 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:24.189972 (+ 5005us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:24.189992 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:24.192991 (+ 2999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":360,"threads_started":1}
W20260807 06:56:24.193562 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:24.180184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:35219 (local address 127.10.191.190:36275)
0807 06:56:24.180400 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:24.180406 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:24.180813 (+ 407us) server_negotiation.cc:407] Connection header received
0807 06:56:24.181006 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:24.181014 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:24.181140 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:24.181249 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:24.182035 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.183089 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.184276 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.184710 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.184801 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:24.193278 (+ 8477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:35219: BlockingRecv error: recv got EOF from 127.10.191.130:35219 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 06:56:24 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:24 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:24.646880 24439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:24.638543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:60833)
0807 06:56:24.639084 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:24.639101 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:24.639221 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:24.639520 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:24.639523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:24.639951 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:24.640115 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:24.640124 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.641041 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.641044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:24.642003 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:24.642015 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.642665 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.642669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:24.642780 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:24.643324 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:24.643342 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:24.646626 (+ 3284us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":308,"threads_started":1}
W20260807 06:56:24.647007 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:24.638631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:60833 (local address 127.10.191.190:36275)
0807 06:56:24.638889 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:24.638895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:24.639190 (+ 295us) server_negotiation.cc:407] Connection header received
0807 06:56:24.639322 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:24.639325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:24.639391 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:24.639480 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:24.640249 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.640915 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.642114 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.642536 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.642631 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:24.646807 (+ 4176us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:60833: BlockingRecv error: recv got EOF from 127.10.191.131:60833 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 06:56:24 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:24 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:24.707224 24441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:24.698256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:42591)
0807 06:56:24.698721 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:24.698738 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:24.698855 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:24.699231 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:24.699236 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:24.699672 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:24.699827 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:24.699836 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.700925 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.700932 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:24.701855 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:24.701869 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.702572 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.702578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:24.702744 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:24.703381 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:24.703400 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:24.706868 (+ 3468us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":247,"threads_started":1}
W20260807 06:56:24.707365 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:24.698366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:42591 (local address 127.10.191.190:36275)
0807 06:56:24.698610 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:24.698616 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:24.698816 (+ 200us) server_negotiation.cc:407] Connection header received
0807 06:56:24.699001 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:24.699006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:24.699094 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:24.699197 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:24.699976 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.700794 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.701996 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:24.702410 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:24.702541 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:24.707079 (+ 4538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:42591: BlockingRecv error: recv got EOF from 127.10.191.129:42591 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 07 06:56:25 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:25 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:25.202544 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:25.194441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:56465)
0807 06:56:25.194932 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:25.194949 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:25.195106 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:25.195429 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:25.195433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:25.195831 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:25.195980 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:25.195988 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.196986 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.196989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:25.197985 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:25.197999 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.198641 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.198650 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:25.198771 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:25.199394 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:25.199412 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:25.202203 (+ 2791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":302,"threads_started":1}
W20260807 06:56:25.202677 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:25.194499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:56465 (local address 127.10.191.190:36275)
0807 06:56:25.194744 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:25.194752 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:25.195024 (+ 272us) server_negotiation.cc:407] Connection header received
0807 06:56:25.195247 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:25.195251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:25.195314 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:25.195387 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:25.196133 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.196873 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.198107 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.198494 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.198584 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:25.202433 (+ 3849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:56465: BlockingRecv error: recv got EOF from 127.10.191.130:56465 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 06:56:25 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:25 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:25.655886 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:25.647936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:48095)
0807 06:56:25.648492 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:25.648508 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:25.648615 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:25.648885 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:25.648888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:25.649294 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:25.649448 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:25.649456 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.650488 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.650492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:25.651384 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:25.651396 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.652070 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.652074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:25.652195 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:25.652777 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:25.652795 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:25.655653 (+ 2858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":344,"threads_started":1}
W20260807 06:56:25.656080 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:25.648199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:48095 (local address 127.10.191.190:36275)
0807 06:56:25.648361 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:25.648365 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:25.648587 (+ 222us) server_negotiation.cc:407] Connection header received
0807 06:56:25.648709 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:25.648712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:25.648771 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:25.648840 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:25.649632 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.650365 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.651519 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.651928 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.652014 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:25.655843 (+ 3829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:48095: BlockingRecv error: recv got EOF from 127.10.191.131:48095 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 06:56:25 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:25 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:25.716081 24447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:25.708167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:47133)
0807 06:56:25.708698 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:25.708713 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:25.708829 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:25.709171 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:25.709175 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:25.709576 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:25.709765 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:25.709774 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.710709 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.710712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:25.711606 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:25.711617 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.712239 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.712242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:25.712369 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:25.712906 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:25.712924 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:25.715843 (+ 2919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":306,"threads_started":1}
W20260807 06:56:25.716282 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:25.708262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:47133 (local address 127.10.191.190:36275)
0807 06:56:25.708437 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:25.708442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:25.708785 (+ 343us) server_negotiation.cc:407] Connection header received
0807 06:56:25.708936 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:25.708939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:25.709012 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:25.709108 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:25.709882 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.710594 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.711722 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:25.712093 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:25.712191 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:25.716052 (+ 3861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:47133: BlockingRecv error: recv got EOF from 127.10.191.129:47133 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 07 06:56:26 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:26 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:26.211776 24448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:26.203665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:49143)
0807 06:56:26.204220 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:26.204238 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:26.204366 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:26.204689 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:26.204692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:26.205180 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:26.205373 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:26.205381 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.206355 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.206359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:26.207254 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:26.207267 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.207935 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.207939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:26.208066 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:26.208624 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:26.208641 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:26.211507 (+ 2866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":377,"threads_started":1}
W20260807 06:56:26.212023 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:26.203960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:49143 (local address 127.10.191.190:36275)
0807 06:56:26.204180 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:26.204186 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:26.204312 (+ 126us) server_negotiation.cc:407] Connection header received
0807 06:56:26.204467 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:26.204471 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:26.204555 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:26.204639 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:26.205496 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.206234 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.207391 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.207800 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.207898 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:26.211777 (+ 3879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:49143: BlockingRecv error: recv got EOF from 127.10.191.130:49143 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 07 06:56:26 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:26 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:26.665362 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:26.656995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:55339)
0807 06:56:26.657587 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:26.657603 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:26.657722 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:26.658135 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:26.658138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:26.658561 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:26.658741 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:26.658748 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.659743 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.659746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:26.660636 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:26.660646 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.661388 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.661392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:26.661514 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:26.662093 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:26.662111 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:26.665134 (+ 3023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":359,"threads_started":1}
W20260807 06:56:26.665526 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:26.657116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:55339 (local address 127.10.191.190:36275)
0807 06:56:26.657302 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:26.657306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:26.657684 (+ 378us) server_negotiation.cc:407] Connection header received
0807 06:56:26.657823 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:26.657826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:26.657911 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:26.658069 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:26.658874 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.659620 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.660782 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.661263 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.661356 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:26.665308 (+ 3952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:55339: BlockingRecv error: recv got EOF from 127.10.191.131:55339 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 07 06:56:26 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:26 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:26.726138 24452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:26.717160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:35345)
0807 06:56:26.717684 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:26.717701 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:26.717824 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:26.718153 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:26.718157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:26.718554 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:26.718730 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:26.718739 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.719739 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.719743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:26.720650 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:26.720663 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.721426 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.721430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:26.721567 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:26.722257 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:26.722276 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:26.725910 (+ 3634us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":288,"threads_started":1}
W20260807 06:56:26.726364 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:26.717224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:35345 (local address 127.10.191.190:36275)
0807 06:56:26.717480 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:26.717487 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:26.717787 (+ 300us) server_negotiation.cc:407] Connection header received
0807 06:56:26.717943 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:26.717946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:26.718025 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:26.718107 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:26.718868 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.719611 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.720781 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:26.721294 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:26.721379 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:26.726098 (+ 4719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:35345: BlockingRecv error: recv got EOF from 127.10.191.129:35345 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 07 06:56:27 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:27 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:27.221553 24453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:27.212935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:60015)
0807 06:56:27.213660 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:27.213679 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:27.213816 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:27.214202 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:27.214208 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:27.214767 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:27.214950 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:27.214959 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.215909 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.215913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:27.216836 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:27.216848 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.217540 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.217545 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:27.217678 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:27.218343 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:27.218362 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:27.221305 (+ 2943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":465,"threads_started":1}
W20260807 06:56:27.221815 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:27.213049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:60015 (local address 127.10.191.190:36275)
0807 06:56:27.213251 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:27.213256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:27.213774 (+ 518us) server_negotiation.cc:407] Connection header received
0807 06:56:27.213927 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:27.213932 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:27.214022 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:27.214124 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:27.215084 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.215787 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.216959 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.217413 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.217521 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:27.221550 (+ 4029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:60015: BlockingRecv error: recv got EOF from 127.10.191.130:60015 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 07 06:56:27 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:27 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:27.675705 24454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:27.666353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:45503)
0807 06:56:27.666996 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:27.667014 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:27.667130 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:27.667434 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:27.667437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:27.667863 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:27.668015 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:27.668022 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.669177 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.669181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:27.670222 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:27.670236 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.671012 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.671017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:27.671211 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:27.671877 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:27.671895 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:27.675325 (+ 3430us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":392,"threads_started":1}
W20260807 06:56:27.675848 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:27.666370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:45503 (local address 127.10.191.190:36275)
0807 06:56:27.666530 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:27.666535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:27.667090 (+ 555us) server_negotiation.cc:407] Connection header received
0807 06:56:27.667229 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:27.667233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:27.667309 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:27.667392 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:27.668173 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.668971 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.670375 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.670860 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.670984 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:27.675580 (+ 4596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:45503: BlockingRecv error: recv got EOF from 127.10.191.131:45503 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 06:56:27 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:27 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:27.735526 24455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:27.727135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:34443)
0807 06:56:27.727714 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:27.727730 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:27.727849 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:27.728164 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:27.728167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:27.728569 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:27.728736 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:27.728745 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.729797 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.729801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:27.730669 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:27.730683 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.731364 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.731368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:27.731487 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:27.732203 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:27.732222 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:27.735229 (+ 3007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":313,"threads_started":1}
W20260807 06:56:27.735811 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:27.727209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:34443 (local address 127.10.191.190:36275)
0807 06:56:27.727391 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:27.727395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:27.727805 (+ 410us) server_negotiation.cc:407] Connection header received
0807 06:56:27.727946 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:27.727949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:27.728012 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:27.728103 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:27.728860 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.729629 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.730792 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:27.731192 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:27.731285 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:27.735499 (+ 4214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:34443: BlockingRecv error: recv got EOF from 127.10.191.129:34443 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 06:56:28 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:28 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:28.231614 24460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:28.222566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:50239)
0807 06:56:28.223204 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:28.223226 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:28.223371 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:28.223790 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:28.223796 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:28.224223 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:28.224382 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:28.224391 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.225468 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.225474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:28.226474 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:28.226488 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.227240 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.227248 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:28.227410 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:28.228097 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:28.228116 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:28.231354 (+ 3238us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":325,"threads_started":1}
W20260807 06:56:28.231906 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:28.222742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:50239 (local address 127.10.191.190:36275)
0807 06:56:28.222960 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:28.222968 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:28.223316 (+ 348us) server_negotiation.cc:407] Connection header received
0807 06:56:28.223519 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:28.223539 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:28.223638 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:28.223748 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:28.224534 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.225331 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.226632 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.227049 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.227198 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:28.231610 (+ 4412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:50239: BlockingRecv error: recv got EOF from 127.10.191.130:50239 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 07 06:56:28 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:28 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:28.684638 24461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:28.676772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:58687)
0807 06:56:28.677353 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:28.677368 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:28.677482 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:28.677775 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:28.677779 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:28.678164 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:28.678315 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:28.678323 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.679272 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.679276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:28.680174 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:28.680184 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.680842 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.680846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:28.680957 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:28.681529 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:28.681545 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:28.684404 (+ 2859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":325,"threads_started":1}
W20260807 06:56:28.684796 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:28.676865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:58687 (local address 127.10.191.190:36275)
0807 06:56:28.677038 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:28.677043 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:28.677443 (+ 400us) server_negotiation.cc:407] Connection header received
0807 06:56:28.677591 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:28.677595 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:28.677657 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:28.677738 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:28.678455 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.679158 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.680297 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.680692 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.680780 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:28.684586 (+ 3806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:58687: BlockingRecv error: recv got EOF from 127.10.191.131:58687 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 06:56:28 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:28 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:28.744987 24462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:28.736692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:54195)
0807 06:56:28.737203 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:28.737220 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:28.737336 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:28.737618 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:28.737621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:28.738011 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:28.738202 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:28.738210 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.739287 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.739291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:28.740207 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:28.740217 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.740877 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.740892 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:28.741009 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:28.741740 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:28.741765 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:28.744735 (+ 2970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":260,"threads_started":1}
W20260807 06:56:28.745209 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:28.736726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:54195 (local address 127.10.191.190:36275)
0807 06:56:28.736959 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:28.736964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:28.737288 (+ 324us) server_negotiation.cc:407] Connection header received
0807 06:56:28.737429 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:28.737433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:28.737495 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:28.737583 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:28.738317 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.739165 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.740327 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:28.740754 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:28.740847 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:28.744935 (+ 4088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:54195: BlockingRecv error: recv got EOF from 127.10.191.129:54195 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 07 06:56:29 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:29 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:29.245885 24463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:29.232815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:34405)
0807 06:56:29.233403 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:29.233426 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:29.233555 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:29.233866 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:29.233869 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:29.234256 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:29.234438 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:29.234446 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.235531 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.235536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:29.236486 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:29.236498 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.237235 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.237240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:29.237390 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:29.242507 (+ 5117us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:29.242529 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:29.245623 (+ 3094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":352,"threads_started":1}
W20260807 06:56:29.246049 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:29.233046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:34405 (local address 127.10.191.190:36275)
0807 06:56:29.233311 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:29.233315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:29.233499 (+ 184us) server_negotiation.cc:407] Connection header received
0807 06:56:29.233664 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:29.233669 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:29.233734 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:29.233821 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:29.234560 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.235390 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.236617 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.237053 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.237179 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:29.245823 (+ 8644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:34405: BlockingRecv error: recv got EOF from 127.10.191.130:34405 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 07 06:56:29 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:29 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.131@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:29.693921 24464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:29.685704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.131:55865)
0807 06:56:29.686202 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:29.686219 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:29.686342 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:29.686644 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:29.686647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:29.687030 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:29.687223 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:29.687233 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.688206 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.688209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:29.689017 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:29.689027 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.689698 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.689701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:29.689812 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:29.690432 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:29.690450 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:29.693583 (+ 3133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":267,"threads_started":1}
W20260807 06:56:29.694051 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:29.685825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:55865 (local address 127.10.191.190:36275)
0807 06:56:29.686104 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:29.686111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:29.686303 (+ 192us) server_negotiation.cc:407] Connection header received
0807 06:56:29.686447 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:29.686450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:29.686515 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:29.686599 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:29.687352 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.688084 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.689179 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.689583 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.689678 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:29.693821 (+ 4143us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.131:55865: BlockingRecv error: recv got EOF from 127.10.191.131:55865 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 07 06:56:29 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:29 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.129@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:29.754892 24465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:29.746370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.129:55237)
0807 06:56:29.746989 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:29.747005 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:29.747170 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:29.747508 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:29.747512 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:29.748006 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:29.748184 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:29.748193 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.749352 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.749356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:29.750209 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:29.750220 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.750912 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.750918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:29.751081 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:29.751792 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:29.751810 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:29.754531 (+ 2721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":377,"threads_started":1}
W20260807 06:56:29.754987 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:29.746423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:55237 (local address 127.10.191.190:36275)
0807 06:56:29.746689 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:29.746698 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:29.747102 (+ 404us) server_negotiation.cc:407] Connection header received
0807 06:56:29.747294 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:29.747299 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:29.747372 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:29.747474 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:29.748321 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.749200 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.750349 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:29.750763 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:29.750887 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:29.754746 (+ 3859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.129:55237: BlockingRecv error: recv got EOF from 127.10.191.129:55237 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 07 06:56:30 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 06:56:30 dist-test-slave-tfpf krb5kdc[23086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.191.130@KRBTEST.COM for oryx/127.10.191.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 06:56:30.255360 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:30.247348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36275 (local address 127.10.191.130:38857)
0807 06:56:30.248004 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:30.248022 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:30.248182 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:30.248513 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:30.248517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:30.248936 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:30.249129 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:30.249138 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.250089 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.250092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:30.250976 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:30.250987 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.251641 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.251645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:30.251770 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:30.252380 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:30.252397 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:30.255091 (+ 2694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.191.190:36275: Server oryx/127.10.191.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":390,"threads_started":1}
W20260807 06:56:30.255683 24061 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:30.247401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:38857 (local address 127.10.191.190:36275)
0807 06:56:30.247615 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:30.247621 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:30.248121 (+ 500us) server_negotiation.cc:407] Connection header received
0807 06:56:30.248321 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:30.248324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:30.248389 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:30.248469 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:30.249238 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.249956 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.251096 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.251523 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.251615 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:30.255341 (+ 3726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.191.130:38857: BlockingRecv error: recv got EOF from 127.10.191.130:38857 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:56:30.535317 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 23865
I20260807 06:56:30.548835 24468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:30.536716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40336 (local address 127.10.191.129:36853)
0807 06:56:30.537369 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:30.537377 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:30.537407 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:56:30.537471 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:30.537477 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:30.537764 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:30.538011 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:30.539775 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.540823 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.542122 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.542706 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.542849 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:30.545629 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:30.545638 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:30.545654 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:30.545713 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:30.548114 (+ 2401us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.191.129@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 06:56:30.548471 (+ 357us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40336: Request ticket server kudu/127.10.191.129@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":335,"threads_started":1}
W20260807 06:56:30.548962 24468 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40336: Request ticket server kudu/127.10.191.129@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 06:56:30.548962 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 23865: Not authorized: Client connection negotiation failed: client connection to 127.10.191.129:36853: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.191.129@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 06:56:30.549275 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 23865
I20260807 06:56:30.578085 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 24063
I20260807 06:56:30.591112 24469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:30.579251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57842 (local address 127.10.191.130:38523)
0807 06:56:30.579792 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:30.579798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:30.579829 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:56:30.579895 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:30.579901 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:30.580110 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:30.580324 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:30.581763 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.582894 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.584159 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.584768 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.584923 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:30.587731 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:30.587740 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:30.587755 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:30.587805 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:30.590312 (+ 2507us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.191.130@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 06:56:30.590680 (+ 368us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57842: Request ticket server kudu/127.10.191.130@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":219,"threads_started":1}
W20260807 06:56:30.591141 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 24063: Not authorized: Client connection negotiation failed: client connection to 127.10.191.130:38523: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.191.130@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 06:56:30.591248 24469 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57842: Request ticket server kudu/127.10.191.130@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 06:56:30.591320 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 24063
I20260807 06:56:30.615957 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 24226
I20260807 06:56:30.629034 24474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:30.617018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53194 (local address 127.10.191.131:40189)
0807 06:56:30.617745 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:30.617755 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:30.617790 (+ 35us) server_negotiation.cc:407] Connection header received
0807 06:56:30.617857 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:30.617863 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:30.618090 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:30.618274 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:30.619618 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.620674 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.622068 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:30.622648 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:30.622746 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:30.625375 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:30.625384 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:30.625398 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:30.625437 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:30.628244 (+ 2807us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.191.131@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 06:56:30.628607 (+ 363us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53194: Request ticket server kudu/127.10.191.131@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":381,"threads_started":1}
W20260807 06:56:30.629187 24474 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53194: Request ticket server kudu/127.10.191.131@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 06:56:30.629269 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 24226: Not authorized: Client connection negotiation failed: client connection to 127.10.191.131:40189: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.191.131@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 06:56:30.629467 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 24226
I20260807 06:56:30.658527 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 23775
I20260807 06:56:30.660000 23857 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:30.776988 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 23775
2026-08-07T06:56:30Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21733 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T06:56:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:56:30Z Disabled control of system clock
I20260807 06:56:30.879763 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35505
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:33811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:35505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 06:56:31.232664 24479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:31.232988 24479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:31.233121 24479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:31.240787 24479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:56:31.240921 24479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:31.240979 24479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:31.241031 24479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:56:31.241153 24479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:56:31.250902 24479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:33811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:35505
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:31.252314 24479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:31.254181 24479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:31.266535 24484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:31.266590 24485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:31.266507 24488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:31.267248 24479 server_base.cc:1034] running on GCE node
I20260807 06:56:31.268131 24479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:31.269760 24479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:31.270991 24479 hybrid_clock.cc:648] HybridClock initialized: now 1786085791270945 us; error 61 us; skew 500 ppm
I20260807 06:56:31.271359 24479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:56:31.273730 24479 webserver.cc:460] Webserver started at http://127.10.191.190:34319/ using document root <none> and password file <none>
I20260807 06:56:31.274549 24479 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:31.274711 24479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:31.275074 24479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:31.278733 24479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "9a5691d5974c41bfa7cd4e87aa851b1f"
format_stamp: "Formatted at 2026-08-07 06:56:31 on dist-test-slave-tfpf"
server_key: "9c626d972516e25bffc5be7886270c1d"
server_key_iv: "1296d740a8cdf9b1f830228aef457c35"
server_key_version: "encryptionkey@0"
I20260807 06:56:31.279639 24479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "9a5691d5974c41bfa7cd4e87aa851b1f"
format_stamp: "Formatted at 2026-08-07 06:56:31 on dist-test-slave-tfpf"
server_key: "9c626d972516e25bffc5be7886270c1d"
server_key_iv: "1296d740a8cdf9b1f830228aef457c35"
server_key_version: "encryptionkey@0"
I20260807 06:56:31.285338 24479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260807 06:56:31.288872 24499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:31.290344 24479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:56:31.290547 24479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "9a5691d5974c41bfa7cd4e87aa851b1f"
format_stamp: "Formatted at 2026-08-07 06:56:31 on dist-test-slave-tfpf"
server_key: "9c626d972516e25bffc5be7886270c1d"
server_key_iv: "1296d740a8cdf9b1f830228aef457c35"
server_key_version: "encryptionkey@0"
I20260807 06:56:31.290789 24479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:31.311497 24479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:31.312438 24479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:31.312763 24479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:31.332321 24479 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:35505
I20260807 06:56:31.332341 24565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:35505 every 8 connection(s)
I20260807 06:56:31.333838 24479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:56:31.337889 24567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:31.340929 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 24479
I20260807 06:56:31.341161 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:56:31.341933 11006 external_mini_cluster.cc:1428] Setting key b64847bd0f3cc871d5ef9452ac0d2637
I20260807 06:56:31.350946 24567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f: Bootstrap starting.
I20260807 06:56:31.354823 24567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:31.356001 24567 log.cc:824] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:31.356091 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:31.344153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.10.191.190:35505)
0807 06:56:31.345243 (+ 1090us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:31.345254 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:31.345297 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:56:31.346908 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:31.346932 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:31.347435 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:31.347783 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:31.348513 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:31.349830 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:31.351596 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:31.352237 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:31.352369 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:31.353735 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:31.353743 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:31.353755 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:31.354312 (+ 557us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:31.354416 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:31.354438 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:31.354526 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:31.354795 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 06:56:31.355128 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":403,"threads_started":1}
I20260807 06:56:31.359313 24567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f: No bootstrap required, opened a new log
I20260807 06:56:31.367112 24567 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a5691d5974c41bfa7cd4e87aa851b1f" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35505 } }
I20260807 06:56:31.367491 24567 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:31.367578 24567 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a5691d5974c41bfa7cd4e87aa851b1f, State: Initialized, Role: FOLLOWER
I20260807 06:56:31.368182 24567 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a5691d5974c41bfa7cd4e87aa851b1f" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35505 } }
I20260807 06:56:31.368484 24567 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:56:31.368672 24567 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:56:31.368850 24567 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:31.371078 24567 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a5691d5974c41bfa7cd4e87aa851b1f" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35505 } }
I20260807 06:56:31.371613 24567 leader_election.cc:302] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a5691d5974c41bfa7cd4e87aa851b1f; no voters:
I20260807 06:56:31.372252 24567 leader_election.cc:288] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:56:31.372411 24574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:31.373265 24574 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [term 1 LEADER]: Becoming Leader. State: Replica: 9a5691d5974c41bfa7cd4e87aa851b1f, State: Running, Role: LEADER
I20260807 06:56:31.373857 24574 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a5691d5974c41bfa7cd4e87aa851b1f" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35505 } }
I20260807 06:56:31.374590 24567 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:56:31.376839 24576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a5691d5974c41bfa7cd4e87aa851b1f. Latest consensus state: current_term: 1 leader_uuid: "9a5691d5974c41bfa7cd4e87aa851b1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a5691d5974c41bfa7cd4e87aa851b1f" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35505 } } }
I20260807 06:56:31.377339 24576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:31.377341 24575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a5691d5974c41bfa7cd4e87aa851b1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a5691d5974c41bfa7cd4e87aa851b1f" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35505 } } }
I20260807 06:56:31.377856 24575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:31.380048 24579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:56:31.385852 24579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:56:31.395349 24579 catalog_manager.cc:1347] Generated new cluster ID: 49a3e9dc3d264ef0a4f90ccd4d8d8bb4
I20260807 06:56:31.395488 24579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:56:31.405766 24579 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:56:31.407368 24579 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:56:31.413172 24579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a5691d5974c41bfa7cd4e87aa851b1f: Generated new TSK 0
I20260807 06:56:31.414265 24579 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:56:31.420068 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35505
--builtin_ntp_servers=127.10.191.148:33811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 06:56:31.773000 24598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:31.773404 24598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:31.773506 24598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:31.780970 24598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:31.781132 24598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:31.781261 24598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:56:31.790535 24598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:33811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:31.791931 24598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:31.793844 24598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:31.806983 24607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:31.807024 24609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:31.806933 24611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:31.807747 24598 server_base.cc:1034] running on GCE node
I20260807 06:56:31.808411 24598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:31.809362 24598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:31.810588 24598 hybrid_clock.cc:648] HybridClock initialized: now 1786085791810548 us; error 46 us; skew 500 ppm
I20260807 06:56:31.810920 24598 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:56:31.813264 24598 webserver.cc:460] Webserver started at http://127.10.191.129:43981/ using document root <none> and password file <none>
I20260807 06:56:31.813975 24598 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:31.814132 24598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:31.814496 24598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:31.817569 24598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "65cc8a817b274c9d9030c2350b23b9ce"
format_stamp: "Formatted at 2026-08-07 06:56:31 on dist-test-slave-tfpf"
server_key: "ab63c59ba4203b649bebfa3ceb2df664"
server_key_iv: "7e070c77c39b1c7dc297b66f1413e3f4"
server_key_version: "encryptionkey@0"
I20260807 06:56:31.818421 24598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "65cc8a817b274c9d9030c2350b23b9ce"
format_stamp: "Formatted at 2026-08-07 06:56:31 on dist-test-slave-tfpf"
server_key: "ab63c59ba4203b649bebfa3ceb2df664"
server_key_iv: "7e070c77c39b1c7dc297b66f1413e3f4"
server_key_version: "encryptionkey@0"
I20260807 06:56:31.824148 24598 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260807 06:56:31.827919 24619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:31.829313 24598 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 06:56:31.829504 24598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "65cc8a817b274c9d9030c2350b23b9ce"
format_stamp: "Formatted at 2026-08-07 06:56:31 on dist-test-slave-tfpf"
server_key: "ab63c59ba4203b649bebfa3ceb2df664"
server_key_iv: "7e070c77c39b1c7dc297b66f1413e3f4"
server_key_version: "encryptionkey@0"
I20260807 06:56:31.829741 24598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:31.850317 24598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:31.851207 24598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:31.851508 24598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:31.852540 24598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:31.854019 24598 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:31.854144 24598 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:31.854274 24598 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:31.854363 24598 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:31.888278 24598 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:44929
I20260807 06:56:31.888370 24767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:44929 every 8 connection(s)
I20260807 06:56:31.889737 24598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:56:31.892982 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 24598
I20260807 06:56:31.893211 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:56:31.894125 11006 external_mini_cluster.cc:1428] Setting key 8149efb18e0a114eb1c1d016c107dc4e
I20260807 06:56:31.896952 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35505
--builtin_ntp_servers=127.10.191.148:33811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 06:56:31.904536 24772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:31.893173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35505 (local address 127.10.191.129:50781)
0807 06:56:31.894160 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:31.894234 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:31.896233 (+ 1999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:31.897047 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:31.897059 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:31.897222 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:31.897839 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:31.897857 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:31.898964 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:31.898968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:31.900231 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:31.900245 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:31.901099 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:31.901108 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:31.901370 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:31.902137 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:56:31.902140 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:31.902190 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:56:31.902278 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:31.902839 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:31.902854 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:31.902862 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 06:56:31.903097 (+ 235us) client_negotiation.cc:240] Negotiation successful
0807 06:56:31.903550 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":329,"threads_started":1}
I20260807 06:56:31.905505 24770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:31.892408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:50781 (local address 127.10.191.190:35505)
0807 06:56:31.892873 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:31.892878 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:31.894360 (+ 1482us) server_negotiation.cc:407] Connection header received
0807 06:56:31.896514 (+ 2154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:31.896520 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:31.896607 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:31.896771 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:31.898028 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:31.898788 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:31.900389 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:31.900809 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:31.900954 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:31.902552 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:31.902570 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:31.902578 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:31.902606 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:31.902684 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:31.902704 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:31.902793 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:31.904982 (+ 2189us) server_negotiation.cc:299] Negotiation successful
0807 06:56:31.905113 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":260,"threads_started":1}
I20260807 06:56:31.907213 24768 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35505
I20260807 06:56:31.907552 24768 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:31.908396 24768 heartbeater.cc:511] Master 127.10.191.190:35505 requested a full tablet report, sending...
I20260807 06:56:31.910599 24523 ts_manager.cc:194] Registered new tserver with Master: 65cc8a817b274c9d9030c2350b23b9ce (127.10.191.129:44929)
I20260807 06:56:31.912072 24523 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.129:50781
W20260807 06:56:32.243034 24774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:32.243376 24774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:32.243543 24774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:32.250844 24774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:32.250985 24774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:32.251176 24774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:56:32.261483 24774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:33811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:32.262894 24774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:32.264736 24774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:32.278400 24781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:32.278522 24782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:32.278556 24785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:32.279547 24774 server_base.cc:1034] running on GCE node
I20260807 06:56:32.280263 24774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:32.281322 24774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:32.282519 24774 hybrid_clock.cc:648] HybridClock initialized: now 1786085792282478 us; error 44 us; skew 500 ppm
I20260807 06:56:32.282862 24774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:56:32.285331 24774 webserver.cc:460] Webserver started at http://127.10.191.130:38815/ using document root <none> and password file <none>
I20260807 06:56:32.286067 24774 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:32.286192 24774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:32.286549 24774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:32.289525 24774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "70c03e0a150e4d438762fd9c8b8ac2fc"
format_stamp: "Formatted at 2026-08-07 06:56:32 on dist-test-slave-tfpf"
server_key: "9b335758c78d030e97730ae891fccc6b"
server_key_iv: "83e03f6b7610ff5ac3a30a46471d51d8"
server_key_version: "encryptionkey@0"
I20260807 06:56:32.290419 24774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "70c03e0a150e4d438762fd9c8b8ac2fc"
format_stamp: "Formatted at 2026-08-07 06:56:32 on dist-test-slave-tfpf"
server_key: "9b335758c78d030e97730ae891fccc6b"
server_key_iv: "83e03f6b7610ff5ac3a30a46471d51d8"
server_key_version: "encryptionkey@0"
I20260807 06:56:32.295674 24774 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260807 06:56:32.299356 24792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:32.300789 24774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:56:32.300982 24774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "70c03e0a150e4d438762fd9c8b8ac2fc"
format_stamp: "Formatted at 2026-08-07 06:56:32 on dist-test-slave-tfpf"
server_key: "9b335758c78d030e97730ae891fccc6b"
server_key_iv: "83e03f6b7610ff5ac3a30a46471d51d8"
server_key_version: "encryptionkey@0"
I20260807 06:56:32.301285 24774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:32.319042 24774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:32.319941 24774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:32.320286 24774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:32.321386 24774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:32.322926 24774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:32.323077 24774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:32.323210 24774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:32.323298 24774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:32.357678 24774 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:37695
I20260807 06:56:32.357739 24944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:37695 every 8 connection(s)
I20260807 06:56:32.359077 24774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:56:32.361938 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 24774
I20260807 06:56:32.362185 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:56:32.362632 11006 external_mini_cluster.cc:1428] Setting key b1197d72eda72924bd5920c2bbd6e641
I20260807 06:56:32.365614 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35505
--builtin_ntp_servers=127.10.191.148:33811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 06:56:32.372668 24770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:32.361752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:56743 (local address 127.10.191.190:35505)
0807 06:56:32.362005 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:32.362022 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:32.363601 (+ 1579us) server_negotiation.cc:407] Connection header received
0807 06:56:32.365589 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:32.365597 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:32.365691 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:32.365806 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:32.366955 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.368175 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.369726 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.370387 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.370539 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:32.371770 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:32.371777 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:32.371784 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:32.371826 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:32.371870 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:32.371888 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:32.371981 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:32.372191 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 06:56:32.372301 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 06:56:32.373543 24947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:32.362375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35505 (local address 127.10.191.130:56743)
0807 06:56:32.363445 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:32.363489 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:32.365318 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:32.366095 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:32.366103 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:32.366193 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:32.366774 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:32.366792 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.368324 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.368328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:32.369566 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:32.369597 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.370593 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.370597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:32.370792 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:32.371475 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:56:32.371478 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:32.371516 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:56:32.371589 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:32.371984 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:32.371992 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:32.371997 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:56:32.372147 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 06:56:32.372439 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":358,"threads_started":1}
I20260807 06:56:32.375212 24945 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35505
I20260807 06:56:32.375573 24945 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:32.376773 24945 heartbeater.cc:511] Master 127.10.191.190:35505 requested a full tablet report, sending...
I20260807 06:56:32.378494 24523 ts_manager.cc:194] Registered new tserver with Master: 70c03e0a150e4d438762fd9c8b8ac2fc (127.10.191.130:37695)
I20260807 06:56:32.379355 24523 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.130:56743
W20260807 06:56:32.713726 24948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:32.714035 24948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:32.714208 24948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:32.721359 24948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:32.721460 24948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:32.721654 24948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:56:32.730706 24948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:33811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:32.732028 24948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:32.733973 24948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:32.747118 24955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:32.747197 24956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:32.747153 24958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:32.748644 24948 server_base.cc:1034] running on GCE node
I20260807 06:56:32.749418 24948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:32.750452 24948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:32.751694 24948 hybrid_clock.cc:648] HybridClock initialized: now 1786085792751638 us; error 49 us; skew 500 ppm
I20260807 06:56:32.752028 24948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:56:32.754398 24948 webserver.cc:460] Webserver started at http://127.10.191.131:34277/ using document root <none> and password file <none>
I20260807 06:56:32.755209 24948 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:32.755347 24948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:32.755705 24948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:32.758985 24948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "36e2420ec9c2490a9c27d1d7d4be09dd"
format_stamp: "Formatted at 2026-08-07 06:56:32 on dist-test-slave-tfpf"
server_key: "9b873b4e2bca735e62fc8496b8971701"
server_key_iv: "3481a9a44a9f43be8003011825f2bf48"
server_key_version: "encryptionkey@0"
I20260807 06:56:32.759895 24948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "36e2420ec9c2490a9c27d1d7d4be09dd"
format_stamp: "Formatted at 2026-08-07 06:56:32 on dist-test-slave-tfpf"
server_key: "9b873b4e2bca735e62fc8496b8971701"
server_key_iv: "3481a9a44a9f43be8003011825f2bf48"
server_key_version: "encryptionkey@0"
I20260807 06:56:32.765448 24948 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 06:56:32.769335 24968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:32.770680 24948 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:56:32.770882 24948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "36e2420ec9c2490a9c27d1d7d4be09dd"
format_stamp: "Formatted at 2026-08-07 06:56:32 on dist-test-slave-tfpf"
server_key: "9b873b4e2bca735e62fc8496b8971701"
server_key_iv: "3481a9a44a9f43be8003011825f2bf48"
server_key_version: "encryptionkey@0"
I20260807 06:56:32.771126 24948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:32.796597 24948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:32.797654 24948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:32.798013 24948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:32.799129 24948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:32.800642 24948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:32.800765 24948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:32.800906 24948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:32.801002 24948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:32.835152 24948 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:38863
I20260807 06:56:32.835249 25120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:38863 every 8 connection(s)
I20260807 06:56:32.836521 24948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:56:32.840159 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 24948
I20260807 06:56:32.840348 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:56:32.841030 11006 external_mini_cluster.cc:1428] Setting key b1ad116401e0597448d6aebc92bd3d2b
I20260807 06:56:32.850381 24770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:32.839515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:41099 (local address 127.10.191.190:35505)
0807 06:56:32.839738 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:32.839742 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:32.841800 (+ 2058us) server_negotiation.cc:407] Connection header received
0807 06:56:32.844208 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:32.844213 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:32.844303 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:32.844403 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:32.845629 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.846362 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.847879 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.848282 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.848370 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:32.849724 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:32.849729 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:32.849732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:32.849749 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:32.849778 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:32.849789 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:32.849855 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:32.850060 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 06:56:32.850135 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:56:32.851370 25124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:32.840247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35505 (local address 127.10.191.131:41099)
0807 06:56:32.841586 (+ 1339us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:32.841650 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:32.843892 (+ 2242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:32.844708 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:32.844716 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:32.844807 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:32.845480 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:32.845498 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.846492 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.846496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:32.847750 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:32.847763 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.848466 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.848471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:32.848663 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:32.849439 (+ 776us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:56:32.849442 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:32.849480 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:56:32.849562 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:32.849871 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:32.849878 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:32.849884 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:56:32.850018 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 06:56:32.850306 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":398,"threads_started":1}
I20260807 06:56:32.852741 25121 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35505
I20260807 06:56:32.853104 25121 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:32.853905 25121 heartbeater.cc:511] Master 127.10.191.190:35505 requested a full tablet report, sending...
I20260807 06:56:32.855471 24523 ts_manager.cc:194] Registered new tserver with Master: 36e2420ec9c2490a9c27d1d7d4be09dd (127.10.191.131:38863)
I20260807 06:56:32.856495 24523 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.131:41099
I20260807 06:56:32.856736 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 06:56:32.862738 24770 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:32.861184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41574 (local address 127.10.191.190:35505)
0807 06:56:32.861379 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:32.861387 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:32.861770 (+ 383us) server_negotiation.cc:407] Connection header received
0807 06:56:32.861946 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:32.861953 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:32.862031 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:32.862127 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:32.862506 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41574: BlockingRecv error: recv got EOF from 127.0.0.1:41574 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 06:56:32.863440 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 24598
I20260807 06:56:32.870639 25136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:32.864363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57500 (local address 127.10.191.129:44929)
0807 06:56:32.864890 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:32.864896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:32.864920 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:56:32.864984 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:32.864989 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:32.865232 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:32.865348 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:32.865690 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.866586 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.867824 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.868356 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.868446 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:32.869388 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:32.869395 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:32.869406 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:32.869981 (+ 575us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:32.870025 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:32.870044 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:32.870129 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:32.870272 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 06:56:32.870374 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":264,"threads_started":1}
I20260807 06:56:32.871820 24761 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:32.954152 24768 heartbeater.cc:503] Master 127.10.191.190:35505 was elected leader, sending a full tablet report...
I20260807 06:56:32.955509 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 24598
W20260807 06:56:32.986053 24504 connection.cc:535] server connection from 127.10.191.129:50781 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 06:56:32.986418 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 24774
I20260807 06:56:32.993839 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:32.987331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59210 (local address 127.10.191.130:37695)
0807 06:56:32.987899 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:32.987906 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:32.987935 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:56:32.988023 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:32.988029 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:32.988244 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:32.988374 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:32.988707 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.989733 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.990895 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:32.991399 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:32.991490 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:32.992454 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:32.992462 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:32.992474 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:32.993055 (+ 581us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:32.993169 (+ 114us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:32.993201 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:32.993295 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:32.993420 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 06:56:32.993530 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":287,"threads_started":1}
I20260807 06:56:32.995160 24940 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:33.073577 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 24774
I20260807 06:56:33.097721 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 24948
I20260807 06:56:33.106243 25140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:33.098738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34298 (local address 127.10.191.131:38863)
0807 06:56:33.099351 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:33.099357 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:33.099389 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:56:33.099449 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:33.099455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:33.099663 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:33.099830 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:33.100303 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:33.101436 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:33.102629 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:33.103227 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:33.103378 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:33.104518 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:33.104526 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:33.104539 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:33.105364 (+ 825us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:33.105413 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:33.105434 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:33.105560 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:33.105729 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 06:56:33.105877 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":318,"threads_started":1}
I20260807 06:56:33.107510 25116 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:33.192219 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 24948
I20260807 06:56:33.218729 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 24479
I20260807 06:56:33.220069 24561 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:33.321449 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 24479
2026-08-07T06:56:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2538 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T06:56:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:56:33Z Disabled control of system clock
I20260807 06:56:33.420994 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:38357
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:41861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:38357
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 06:56:33.765147 25147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:33.765493 25147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:33.765688 25147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:33.772712 25147 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:56:33.772811 25147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:33.772907 25147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:33.773016 25147 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:56:33.773136 25147 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:56:33.782405 25147 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:41861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:38357
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:38357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:33.783748 25147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:33.785575 25147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:33.797465 25156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:33.797508 25163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:33.797531 25158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:33.798805 25147 server_base.cc:1034] running on GCE node
I20260807 06:56:33.799794 25147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:33.801592 25147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:33.802850 25147 hybrid_clock.cc:648] HybridClock initialized: now 1786085793802795 us; error 58 us; skew 500 ppm
I20260807 06:56:33.803258 25147 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:56:33.805804 25147 webserver.cc:460] Webserver started at http://127.10.191.190:40633/ using document root <none> and password file <none>
I20260807 06:56:33.806542 25147 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:33.806689 25147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:33.807065 25147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:33.811951 25147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "e46f6b4c36cd4f93a43840332c5b7791"
format_stamp: "Formatted at 2026-08-07 06:56:33 on dist-test-slave-tfpf"
server_key: "be25a6c154443f4edb39e98cf8d8ec6d"
server_key_iv: "8230781689a3c7696ff0c2c0b376891a"
server_key_version: "encryptionkey@0"
I20260807 06:56:33.812805 25147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "e46f6b4c36cd4f93a43840332c5b7791"
format_stamp: "Formatted at 2026-08-07 06:56:33 on dist-test-slave-tfpf"
server_key: "be25a6c154443f4edb39e98cf8d8ec6d"
server_key_iv: "8230781689a3c7696ff0c2c0b376891a"
server_key_version: "encryptionkey@0"
I20260807 06:56:33.818321 25147 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 06:56:33.821842 25171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:33.823169 25147 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:56:33.823351 25147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "e46f6b4c36cd4f93a43840332c5b7791"
format_stamp: "Formatted at 2026-08-07 06:56:33 on dist-test-slave-tfpf"
server_key: "be25a6c154443f4edb39e98cf8d8ec6d"
server_key_iv: "8230781689a3c7696ff0c2c0b376891a"
server_key_version: "encryptionkey@0"
I20260807 06:56:33.823589 25147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:33.829458 25147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:33.830192 25147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:33.830477 25147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:33.849244 25147 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:38357
I20260807 06:56:33.849262 25239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:38357 every 8 connection(s)
I20260807 06:56:33.850745 25147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:56:33.854858 25241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:33.860975 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 25147
I20260807 06:56:33.861258 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:56:33.862118 11006 external_mini_cluster.cc:1428] Setting key 940f8ceb7e6e1564f113c3a6d2f2c647
I20260807 06:56:33.867153 25241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791: Bootstrap starting.
I20260807 06:56:33.872061 25245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:33.864573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34886 (local address 127.10.191.190:38357)
0807 06:56:33.865717 (+ 1144us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:33.865728 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:33.865773 (+ 45us) server_negotiation.cc:407] Connection header received
0807 06:56:33.867603 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:33.867627 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:33.868170 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:33.868552 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:33.869781 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:33.869792 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:33.869819 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:33.869835 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:33.869931 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:33.869956 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:33.870195 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:33.870331 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 06:56:33.870623 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":447,"threads_started":1}
I20260807 06:56:33.872195 25241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:33.873684 25241 log.cc:824] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:33.876736 25241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791: No bootstrap required, opened a new log
I20260807 06:56:33.884617 25241 raft_consensus.cc:348] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46f6b4c36cd4f93a43840332c5b7791" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38357 } }
I20260807 06:56:33.885133 25241 raft_consensus.cc:374] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:33.885252 25241 raft_consensus.cc:729] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46f6b4c36cd4f93a43840332c5b7791, State: Initialized, Role: FOLLOWER
I20260807 06:56:33.885874 25241 consensus_queue.cc:260] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46f6b4c36cd4f93a43840332c5b7791" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38357 } }
I20260807 06:56:33.886119 25241 raft_consensus.cc:388] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:56:33.886264 25241 raft_consensus.cc:482] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:56:33.886474 25241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:33.888794 25241 raft_consensus.cc:504] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46f6b4c36cd4f93a43840332c5b7791" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38357 } }
I20260807 06:56:33.889415 25241 leader_election.cc:302] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e46f6b4c36cd4f93a43840332c5b7791; no voters:
I20260807 06:56:33.890131 25241 leader_election.cc:288] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:56:33.890332 25247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:33.891626 25247 raft_consensus.cc:686] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [term 1 LEADER]: Becoming Leader. State: Replica: e46f6b4c36cd4f93a43840332c5b7791, State: Running, Role: LEADER
I20260807 06:56:33.892302 25247 consensus_queue.cc:237] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46f6b4c36cd4f93a43840332c5b7791" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38357 } }
I20260807 06:56:33.892690 25241 sys_catalog.cc:564] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:56:33.895634 25249 sys_catalog.cc:455] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e46f6b4c36cd4f93a43840332c5b7791. Latest consensus state: current_term: 1 leader_uuid: "e46f6b4c36cd4f93a43840332c5b7791" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46f6b4c36cd4f93a43840332c5b7791" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38357 } } }
I20260807 06:56:33.895632 25248 sys_catalog.cc:455] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e46f6b4c36cd4f93a43840332c5b7791" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46f6b4c36cd4f93a43840332c5b7791" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38357 } } }
I20260807 06:56:33.896178 25249 sys_catalog.cc:458] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:33.896260 25248 sys_catalog.cc:458] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:33.900079 25256 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:56:33.904874 25256 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:56:33.914460 25256 catalog_manager.cc:1347] Generated new cluster ID: d308495fb0b44f3d93c3068819646daf
I20260807 06:56:33.914606 25256 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:56:33.938330 25256 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:56:33.938781 25256 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:56:33.945477 25256 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e46f6b4c36cd4f93a43840332c5b7791: Generated new TSK 0
I20260807 06:56:33.946333 25256 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:56:33.956542 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38357
--builtin_ntp_servers=127.10.191.148:41861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 06:56:34.313947 25272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:34.314222 25272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:34.314388 25272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:34.321617 25272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:34.321740 25272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:34.321941 25272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:56:34.331308 25272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:41861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:34.332695 25272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:34.334702 25272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:34.348176 25283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:34.348248 25279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:34.348279 25280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:34.349195 25272 server_base.cc:1034] running on GCE node
I20260807 06:56:34.349783 25272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:34.350683 25272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:34.351934 25272 hybrid_clock.cc:648] HybridClock initialized: now 1786085794351880 us; error 47 us; skew 500 ppm
I20260807 06:56:34.352285 25272 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:56:34.358784 25272 webserver.cc:460] Webserver started at http://127.10.191.129:36083/ using document root <none> and password file <none>
I20260807 06:56:34.359546 25272 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:34.359685 25272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:34.360038 25272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:34.363108 25272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "2a09c0ef25c148d5aff4d02e749f22b0"
format_stamp: "Formatted at 2026-08-07 06:56:34 on dist-test-slave-tfpf"
server_key: "d4bb3cadc85b0e2f51efa76b3e2a9009"
server_key_iv: "6b0ccc86e61a650164851eb5f3d01922"
server_key_version: "encryptionkey@0"
I20260807 06:56:34.363885 25272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "2a09c0ef25c148d5aff4d02e749f22b0"
format_stamp: "Formatted at 2026-08-07 06:56:34 on dist-test-slave-tfpf"
server_key: "d4bb3cadc85b0e2f51efa76b3e2a9009"
server_key_iv: "6b0ccc86e61a650164851eb5f3d01922"
server_key_version: "encryptionkey@0"
I20260807 06:56:34.369277 25272 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 06:56:34.372915 25292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:34.374408 25272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:56:34.374603 25272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "2a09c0ef25c148d5aff4d02e749f22b0"
format_stamp: "Formatted at 2026-08-07 06:56:34 on dist-test-slave-tfpf"
server_key: "d4bb3cadc85b0e2f51efa76b3e2a9009"
server_key_iv: "6b0ccc86e61a650164851eb5f3d01922"
server_key_version: "encryptionkey@0"
I20260807 06:56:34.374830 25272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:34.380761 25272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:34.381780 25272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:34.382076 25272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:34.383060 25272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:34.384580 25272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:34.384729 25272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:34.384871 25272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:34.384961 25272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:34.419148 25272 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:44421
I20260807 06:56:34.419245 25443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:44421 every 8 connection(s)
I20260807 06:56:34.420574 25272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:56:34.424517 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 25272
I20260807 06:56:34.424789 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:56:34.425661 11006 external_mini_cluster.cc:1428] Setting key fe911687e27124057bc58d411400ba23
I20260807 06:56:34.428912 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38357
--builtin_ntp_servers=127.10.191.148:41861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 06:56:34.430442 25446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:34.423447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:57297 (local address 127.10.191.190:38357)
0807 06:56:34.423912 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:34.423916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:34.425550 (+ 1634us) server_negotiation.cc:407] Connection header received
0807 06:56:34.427754 (+ 2204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:34.427760 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:34.427825 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:34.427944 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:34.429508 (+ 1564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:34.429518 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:34.429525 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:34.429549 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:34.429626 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:34.429645 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:34.429777 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:34.429959 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 06:56:34.430028 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":235,"threads_started":1}
I20260807 06:56:34.431195 25449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:34.424175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:38357 (local address 127.10.191.129:57297)
0807 06:56:34.425380 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:34.425427 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:34.427365 (+ 1938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:34.428248 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:34.428257 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:34.428394 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:34.429203 (+ 809us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:56:34.429205 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:34.429246 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:56:34.429333 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:34.429751 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:34.429759 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:34.429765 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 06:56:34.429999 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 06:56:34.430200 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":375,"threads_started":1}
I20260807 06:56:34.432775 25444 heartbeater.cc:347] Connected to a master server at 127.10.191.190:38357
I20260807 06:56:34.433153 25444 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:34.433936 25444 heartbeater.cc:511] Master 127.10.191.190:38357 requested a full tablet report, sending...
I20260807 06:56:34.436203 25195 ts_manager.cc:194] Registered new tserver with Master: 2a09c0ef25c148d5aff4d02e749f22b0 (127.10.191.129:44421)
W20260807 06:56:34.772683 25450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:34.773006 25450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:34.773222 25450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:34.780359 25450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:34.780443 25450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:34.780627 25450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:56:34.789359 25450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:41861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:34.790603 25450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:34.792275 25450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:34.805356 25458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:34.805418 25459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:34.805419 25461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:34.806223 25450 server_base.cc:1034] running on GCE node
I20260807 06:56:34.806910 25450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:34.807921 25450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:34.809159 25450 hybrid_clock.cc:648] HybridClock initialized: now 1786085794809098 us; error 64 us; skew 500 ppm
I20260807 06:56:34.809478 25450 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:56:34.811653 25450 webserver.cc:460] Webserver started at http://127.10.191.130:34269/ using document root <none> and password file <none>
I20260807 06:56:34.812325 25450 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:34.812455 25450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:34.812837 25450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:34.815719 25450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "f87a51fcbcac4a48956a0ef21297a1ba"
format_stamp: "Formatted at 2026-08-07 06:56:34 on dist-test-slave-tfpf"
server_key: "f3eb9423299b47066e64463c3c6b7c9f"
server_key_iv: "6cf41424953f986ca5f98368b15b1bbe"
server_key_version: "encryptionkey@0"
I20260807 06:56:34.816495 25450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "f87a51fcbcac4a48956a0ef21297a1ba"
format_stamp: "Formatted at 2026-08-07 06:56:34 on dist-test-slave-tfpf"
server_key: "f3eb9423299b47066e64463c3c6b7c9f"
server_key_iv: "6cf41424953f986ca5f98368b15b1bbe"
server_key_version: "encryptionkey@0"
I20260807 06:56:34.821902 25450 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 06:56:34.825361 25471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:34.826737 25450 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:56:34.826876 25450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "f87a51fcbcac4a48956a0ef21297a1ba"
format_stamp: "Formatted at 2026-08-07 06:56:34 on dist-test-slave-tfpf"
server_key: "f3eb9423299b47066e64463c3c6b7c9f"
server_key_iv: "6cf41424953f986ca5f98368b15b1bbe"
server_key_version: "encryptionkey@0"
I20260807 06:56:34.827091 25450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:34.832473 25450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:34.833325 25450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:34.833567 25450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:34.834435 25450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:34.835836 25450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:34.835949 25450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:34.836072 25450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:34.836154 25450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:34.869702 25450 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:39309
I20260807 06:56:34.869792 25620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:39309 every 8 connection(s)
I20260807 06:56:34.871040 25450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:56:34.871920 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 25450
I20260807 06:56:34.872105 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:56:34.872671 11006 external_mini_cluster.cc:1428] Setting key d9c1be0903b16d2c444e6c16164156b5
I20260807 06:56:34.875574 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38357
--builtin_ntp_servers=127.10.191.148:41861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 06:56:34.879601 25446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:34.873734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:45831 (local address 127.10.191.190:38357)
0807 06:56:34.873901 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:34.873904 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:34.875581 (+ 1677us) server_negotiation.cc:407] Connection header received
0807 06:56:34.877344 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:34.877353 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:34.877422 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:34.877541 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:34.878815 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:34.878824 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:34.878831 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:34.878854 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:34.878897 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:34.878914 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:34.879044 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:34.879199 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 06:56:34.879265 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:56:34.880504 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:34.874345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:38357 (local address 127.10.191.130:45831)
0807 06:56:34.875420 (+ 1075us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:34.875462 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:34.877014 (+ 1552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:34.877733 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:34.877741 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:34.877826 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:34.878526 (+ 700us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:56:34.878528 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:34.878564 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:56:34.878648 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:34.879013 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:34.879020 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:34.879025 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 06:56:34.879242 (+ 217us) client_negotiation.cc:240] Negotiation successful
0807 06:56:34.879541 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":359,"threads_started":1}
I20260807 06:56:34.881889 25621 heartbeater.cc:347] Connected to a master server at 127.10.191.190:38357
I20260807 06:56:34.882189 25621 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:34.882782 25621 heartbeater.cc:511] Master 127.10.191.190:38357 requested a full tablet report, sending...
I20260807 06:56:34.884189 25195 ts_manager.cc:194] Registered new tserver with Master: f87a51fcbcac4a48956a0ef21297a1ba (127.10.191.130:39309)
W20260807 06:56:35.219784 25627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:35.220074 25627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:35.220165 25627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:35.227484 25627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:35.227594 25627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:35.227833 25627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:56:35.236915 25627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:41861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:35.238298 25627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:35.240142 25627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:35.253687 25632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:35.253708 25633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:35.253859 25636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:35.254894 25627 server_base.cc:1034] running on GCE node
I20260807 06:56:35.255537 25627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:35.256563 25627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:35.257761 25627 hybrid_clock.cc:648] HybridClock initialized: now 1786085795257713 us; error 40 us; skew 500 ppm
I20260807 06:56:35.258083 25627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 06:56:35.260372 25627 webserver.cc:460] Webserver started at http://127.10.191.131:33159/ using document root <none> and password file <none>
I20260807 06:56:35.261137 25627 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:35.261261 25627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:35.261603 25627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:35.264411 25627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "c178288e114c4948bd1270795e791189"
format_stamp: "Formatted at 2026-08-07 06:56:35 on dist-test-slave-tfpf"
server_key: "f199bdfb103afc6685984ecbf75fc7fe"
server_key_iv: "9ad75dc47d1be881e6c746965e762b87"
server_key_version: "encryptionkey@0"
I20260807 06:56:35.265295 25627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "c178288e114c4948bd1270795e791189"
format_stamp: "Formatted at 2026-08-07 06:56:35 on dist-test-slave-tfpf"
server_key: "f199bdfb103afc6685984ecbf75fc7fe"
server_key_iv: "9ad75dc47d1be881e6c746965e762b87"
server_key_version: "encryptionkey@0"
I20260807 06:56:35.270856 25627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 06:56:35.274464 25642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:35.275817 25627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:56:35.275978 25627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "c178288e114c4948bd1270795e791189"
format_stamp: "Formatted at 2026-08-07 06:56:35 on dist-test-slave-tfpf"
server_key: "f199bdfb103afc6685984ecbf75fc7fe"
server_key_iv: "9ad75dc47d1be881e6c746965e762b87"
server_key_version: "encryptionkey@0"
I20260807 06:56:35.276212 25627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:35.282255 25627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:35.283034 25627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:35.283305 25627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:35.284186 25627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:35.285614 25627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:35.285732 25627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:35.285858 25627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:35.285948 25627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:35.318835 25627 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:34137
I20260807 06:56:35.318905 25787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:34137 every 8 connection(s)
I20260807 06:56:35.320199 25627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:56:35.327874 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 25627
I20260807 06:56:35.328107 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:56:35.328598 11006 external_mini_cluster.cc:1428] Setting key dbb397d13a10d64cafb264e1dd75edd4
I20260807 06:56:35.329222 25446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:35.323177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:53183 (local address 127.10.191.190:38357)
0807 06:56:35.323364 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:35.323369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:35.324813 (+ 1444us) server_negotiation.cc:407] Connection header received
0807 06:56:35.326638 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:35.326644 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:35.326727 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:35.326846 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:35.328343 (+ 1497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:35.328349 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:35.328354 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:35.328377 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:35.328419 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:35.328430 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:35.328569 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:35.328817 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 06:56:35.328893 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:56:35.330238 25790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:35.323726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:38357 (local address 127.10.191.131:53183)
0807 06:56:35.324647 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:35.324690 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:35.326342 (+ 1652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:35.327124 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:35.327132 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:35.327226 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:35.327951 (+ 725us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 06:56:35.327953 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:35.327993 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 06:56:35.328138 (+ 145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:35.328529 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:35.328542 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:35.328551 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 06:56:35.328858 (+ 307us) client_negotiation.cc:240] Negotiation successful
0807 06:56:35.329057 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":273,"threads_started":1}
I20260807 06:56:35.331837 25788 heartbeater.cc:347] Connected to a master server at 127.10.191.190:38357
I20260807 06:56:35.332298 25788 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:35.332899 25788 heartbeater.cc:511] Master 127.10.191.190:38357 requested a full tablet report, sending...
I20260807 06:56:35.334297 25195 ts_manager.cc:194] Registered new tserver with Master: c178288e114c4948bd1270795e791189 (127.10.191.131:34137)
I20260807 06:56:35.344208 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 06:56:35.350796 25446 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 06:56:35.348960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34900 (local address 127.10.191.190:38357)
0807 06:56:35.349140 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:35.349144 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:35.349693 (+ 549us) server_negotiation.cc:407] Connection header received
0807 06:56:35.349903 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:35.349910 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:35.349974 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:35.350075 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:35.350504 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34900: BlockingRecv error: recv got EOF from 127.0.0.1:34900 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:56:35.351387 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 25272
I20260807 06:56:35.354809 25799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:35.352324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56260 (local address 127.10.191.129:44421)
0807 06:56:35.352867 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:35.352874 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:35.352901 (+ 27us) server_negotiation.cc:407] Connection header received
0807 06:56:35.352959 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:35.352964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:35.353235 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:35.353360 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:35.354231 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:35.354237 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:35.354248 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:35.354267 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:35.354312 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:35.354326 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:35.354429 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:35.354508 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 06:56:35.354586 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":277,"threads_started":1}
I20260807 06:56:35.356005 25435 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:35.434077 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 25272
I20260807 06:56:35.458154 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 25450
I20260807 06:56:35.461895 25803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:35.459146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38800 (local address 127.10.191.130:39309)
0807 06:56:35.459729 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:35.459736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:35.459766 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:56:35.459834 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:35.459841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:35.460059 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:35.460195 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:35.461240 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:35.461247 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:35.461259 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:35.461277 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:35.461318 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:35.461331 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:35.461438 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:35.461567 (+ 129us) server_negotiation.cc:299] Negotiation successful
0807 06:56:35.461652 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":268,"threads_started":1}
I20260807 06:56:35.463238 25615 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:35.541731 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 25450
I20260807 06:56:35.567086 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 25627
I20260807 06:56:35.571372 25805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:35.568121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44384 (local address 127.10.191.131:34137)
0807 06:56:35.568807 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:35.568815 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:35.568846 (+ 31us) server_negotiation.cc:407] Connection header received
0807 06:56:35.568910 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:35.568916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:35.569217 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:35.569400 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:35.570596 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:35.570603 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:35.570614 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 06:56:35.570630 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:35.570670 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 06:56:35.570685 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:35.570874 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:35.570951 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 06:56:35.571057 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":372,"threads_started":1}
I20260807 06:56:35.572731 25782 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:35.652756 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 25627
I20260807 06:56:35.677783 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 25147
I20260807 06:56:35.679082 25235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:35.778738 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 25147
2026-08-07T06:56:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2453 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:56:35 dist-test-slave-tfpf krb5kdc[25811](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:56:35 dist-test-slave-tfpf krb5kdc[25811](info): set up 2 sockets
Aug 07 06:56:35 dist-test-slave-tfpf krb5kdc[25811](info): commencing operation
krb5kdc: starting...
W20260807 06:56:37.061337 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:56:37 dist-test-slave-tfpf krb5kdc[25811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:56:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:56:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:56:37.374125 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:39457
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:39457
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:37.718250 25829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:37.718668 25829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:37.718868 25829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:37.725966 25829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:56:37.726147 25829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:37.726253 25829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:37.726346 25829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:56:37.726408 25829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:56:37.736495 25829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:39457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:39457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:37.738008 25829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:37.739356 25829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:37.751138 25842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:37.751461 25846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:37.751508 25844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:37.752502 25829 server_base.cc:1034] running on GCE node
I20260807 06:56:37.753407 25829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:37.754905 25829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:37.756146 25829 hybrid_clock.cc:648] HybridClock initialized: now 1786085797756102 us; error 51 us; skew 500 ppm
I20260807 06:56:37.756559 25829 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:37 dist-test-slave-tfpf krb5kdc[25811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085797, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:37.759853 25829 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:56:37.761396 25829 webserver.cc:460] Webserver started at http://127.10.191.190:43519/ using document root <none> and password file <none>
I20260807 06:56:37.762084 25829 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:37.762226 25829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:37.762553 25829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:37.765524 25829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "5b1afd10e6f24eb390c1388365eeb5d9"
format_stamp: "Formatted at 2026-08-07 06:56:37 on dist-test-slave-tfpf"
server_key: "c058c0543a5d20cd542324492be3204f"
server_key_iv: "3a41281d5c635bf02e9c8dc907c1c6e7"
server_key_version: "encryptionkey@0"
I20260807 06:56:37.766265 25829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "5b1afd10e6f24eb390c1388365eeb5d9"
format_stamp: "Formatted at 2026-08-07 06:56:37 on dist-test-slave-tfpf"
server_key: "c058c0543a5d20cd542324492be3204f"
server_key_iv: "3a41281d5c635bf02e9c8dc907c1c6e7"
server_key_version: "encryptionkey@0"
I20260807 06:56:37.771397 25829 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:56:37.774658 25854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:37.775883 25829 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:56:37.776084 25829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "5b1afd10e6f24eb390c1388365eeb5d9"
format_stamp: "Formatted at 2026-08-07 06:56:37 on dist-test-slave-tfpf"
server_key: "c058c0543a5d20cd542324492be3204f"
server_key_iv: "3a41281d5c635bf02e9c8dc907c1c6e7"
server_key_version: "encryptionkey@0"
I20260807 06:56:37.776285 25829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:37.792124 25829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:37.796618 25829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:37.796950 25829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:37.815713 25829 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:39457
I20260807 06:56:37.815734 25926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:39457 every 8 connection(s)
I20260807 06:56:37.817131 25829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:56:37.820904 25929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:37.825734 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 25829
I20260807 06:56:37.826010 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:56:37.826838 11006 external_mini_cluster.cc:1428] Setting key ea72ea7e10770ae77e090e6301c90a65
I20260807 06:56:37.832567 25929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9: Bootstrap starting.
I20260807 06:56:37.836565 25929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:37.837954 25929 log.cc:824] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:37.840982 25929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9: No bootstrap required, opened a new log
Aug 07 06:56:37 dist-test-slave-tfpf krb5kdc[25811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:56:37.850085 25929 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1afd10e6f24eb390c1388365eeb5d9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39457 } }
I20260807 06:56:37.850453 25929 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:37.850605 25929 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b1afd10e6f24eb390c1388365eeb5d9, State: Initialized, Role: FOLLOWER
I20260807 06:56:37.850697 25933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:37.829052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45276 (local address 127.10.191.190:39457)
0807 06:56:37.829962 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:37.829974 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:37.830026 (+ 52us) server_negotiation.cc:407] Connection header received
0807 06:56:37.831710 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:37.831733 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:37.832131 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:37.832448 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:37.834426 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:37.835734 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:37.837609 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:37.838393 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:37.838673 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:37.843263 (+ 4590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:37.843270 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:37.843284 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:37.843330 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:37.846494 (+ 3164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:37.847354 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:37.847360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:37.847366 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:37.847542 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:37.847946 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:37.847949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:37.847951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:37.848544 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:37.848772 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:37.849250 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 06:56:37.849645 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":393,"threads_started":1}
I20260807 06:56:37.851249 25929 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1afd10e6f24eb390c1388365eeb5d9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39457 } }
I20260807 06:56:37.851569 25929 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:56:37.851737 25929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:56:37.851953 25929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:37.854645 25929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1afd10e6f24eb390c1388365eeb5d9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39457 } }
I20260807 06:56:37.855067 25929 leader_election.cc:302] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b1afd10e6f24eb390c1388365eeb5d9; no voters:
I20260807 06:56:37.855724 25929 leader_election.cc:288] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:56:37.855829 25935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:37.856595 25935 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [term 1 LEADER]: Becoming Leader. State: Replica: 5b1afd10e6f24eb390c1388365eeb5d9, State: Running, Role: LEADER
I20260807 06:56:37.857180 25935 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1afd10e6f24eb390c1388365eeb5d9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39457 } }
I20260807 06:56:37.857867 25929 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:56:37.860261 25938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b1afd10e6f24eb390c1388365eeb5d9. Latest consensus state: current_term: 1 leader_uuid: "5b1afd10e6f24eb390c1388365eeb5d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1afd10e6f24eb390c1388365eeb5d9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39457 } } }
I20260807 06:56:37.860692 25938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:37.861826 25944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:56:37.861785 25937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b1afd10e6f24eb390c1388365eeb5d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1afd10e6f24eb390c1388365eeb5d9" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39457 } } }
I20260807 06:56:37.862155 25937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9 [sys.catalog]: This master's current role is: LEADER
I20260807 06:56:37.866998 25944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:56:37.876546 25944 catalog_manager.cc:1347] Generated new cluster ID: 908bcac1afb546ed9c4359c01caf7b84
I20260807 06:56:37.876691 25944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:56:37.886919 25944 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:56:37.888235 25944 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:56:37.895483 25944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9: Generated new TSK 0
I20260807 06:56:37.896425 25944 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:56:37.972848 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:39457
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:38.325837 25962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:38.326161 25962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:38.326332 25962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:38.333425 25962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:38.333609 25962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:38.333829 25962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:56:38.343621 25962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:39457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:38.345013 25962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:38.346343 25962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:38.360201 25969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:38.360126 25970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:38.360183 25973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:38.361352 25962 server_base.cc:1034] running on GCE node
I20260807 06:56:38.362121 25962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:38.363049 25962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:38.364260 25962 hybrid_clock.cc:648] HybridClock initialized: now 1786085798364207 us; error 41 us; skew 500 ppm
I20260807 06:56:38.364579 25962 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:38 dist-test-slave-tfpf krb5kdc[25811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085798, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:38.367908 25962 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:56:38.369553 25962 webserver.cc:460] Webserver started at http://127.10.191.129:36355/ using document root <none> and password file <none>
I20260807 06:56:38.370323 25962 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:38.370486 25962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:38.370817 25962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:38.373874 25962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "d35bef565148492a81bec0c9de3d3a5f"
format_stamp: "Formatted at 2026-08-07 06:56:38 on dist-test-slave-tfpf"
server_key: "6b572a02596cdfb3c5eb45cac1867ea1"
server_key_iv: "4730f821a7ea3a7430ac177bcb4e53a8"
server_key_version: "encryptionkey@0"
I20260807 06:56:38.374715 25962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "d35bef565148492a81bec0c9de3d3a5f"
format_stamp: "Formatted at 2026-08-07 06:56:38 on dist-test-slave-tfpf"
server_key: "6b572a02596cdfb3c5eb45cac1867ea1"
server_key_iv: "4730f821a7ea3a7430ac177bcb4e53a8"
server_key_version: "encryptionkey@0"
I20260807 06:56:38.380249 25962 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 06:56:38.383759 25981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:38.385004 25962 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:56:38.385236 25962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "d35bef565148492a81bec0c9de3d3a5f"
format_stamp: "Formatted at 2026-08-07 06:56:38 on dist-test-slave-tfpf"
server_key: "6b572a02596cdfb3c5eb45cac1867ea1"
server_key_iv: "4730f821a7ea3a7430ac177bcb4e53a8"
server_key_version: "encryptionkey@0"
I20260807 06:56:38.385440 25962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:38.401895 25962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:38.405813 25962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:38.406100 25962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:38.407027 25962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:38.408464 25962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:38.408584 25962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:38.408727 25962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:38.408797 25962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:38.442745 25962 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:35223
I20260807 06:56:38.442781 26127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:35223 every 8 connection(s)
I20260807 06:56:38.444037 25962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:56:38.445914 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 25962
I20260807 06:56:38.446163 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:56:38.447052 11006 external_mini_cluster.cc:1428] Setting key 417d00287346f599efc16fe0ebac548b
Aug 07 06:56:38 dist-test-slave-tfpf krb5kdc[25811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085798, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:56:38.468446 26131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:38.446797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:37909 (local address 127.10.191.190:39457)
0807 06:56:38.447312 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:38.447317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:38.448586 (+ 1269us) server_negotiation.cc:407] Connection header received
0807 06:56:38.450993 (+ 2407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:38.450997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:38.451077 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:38.451158 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:38.453299 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:38.453996 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:38.456411 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:38.456850 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:38.456956 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:38.461551 (+ 4595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:38.461556 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:38.461567 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:38.461599 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:38.464842 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:38.465632 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:38.465641 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:38.465647 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:38.465803 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:38.466291 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:38.466298 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:38.466304 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:38.466695 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:38.466860 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:38.467660 (+ 800us) server_negotiation.cc:299] Negotiation successful
0807 06:56:38.467924 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":260,"threads_started":1}
I20260807 06:56:38.469239 26132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:38.447464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:39457 (local address 127.10.191.129:37909)
0807 06:56:38.448388 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:38.448445 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:38.450702 (+ 2257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:38.451453 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:38.451467 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:38.452274 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:38.453110 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:38.453139 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:38.454163 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:38.454169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:38.456178 (+ 2009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:38.456195 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:38.457121 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:38.457133 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:38.457491 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:38.458247 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:38.458288 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:38.461326 (+ 3038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:38.464985 (+ 3659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:38.464992 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:38.465005 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:38.465493 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:38.465913 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:38.465916 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:38.465918 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:38.466157 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:38.466845 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:38.466850 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:38.467178 (+ 328us) client_negotiation.cc:769] Sending connection context
0807 06:56:38.467531 (+ 353us) client_negotiation.cc:240] Negotiation successful
0807 06:56:38.468007 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":392,"threads_started":1}
I20260807 06:56:38.470912 26128 heartbeater.cc:347] Connected to a master server at 127.10.191.190:39457
I20260807 06:56:38.471238 26128 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:38.472025 26128 heartbeater.cc:511] Master 127.10.191.190:39457 requested a full tablet report, sending...
I20260807 06:56:38.474220 25881 ts_manager.cc:194] Registered new tserver with Master: d35bef565148492a81bec0c9de3d3a5f (127.10.191.129:35223)
I20260807 06:56:38.475657 25881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:37909
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:56:38.515982 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:39457
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:38.853150 26135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:38.853494 26135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:38.853703 26135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:38.860692 26135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:38.860832 26135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:38.860996 26135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:56:38.870621 26135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:39457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:38.871892 26135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:38.873291 26135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:38.886454 26143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:38.886425 26148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:38.886730 26146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:38.887633 26135 server_base.cc:1034] running on GCE node
I20260807 06:56:38.888279 26135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:38.889345 26135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:38.890545 26135 hybrid_clock.cc:648] HybridClock initialized: now 1786085798890481 us; error 56 us; skew 500 ppm
I20260807 06:56:38.890827 26135 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:38 dist-test-slave-tfpf krb5kdc[25811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085798, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:38.893952 26135 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:56:38.895223 26135 webserver.cc:460] Webserver started at http://127.10.191.130:37667/ using document root <none> and password file <none>
I20260807 06:56:38.895869 26135 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:38.895967 26135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:38.896217 26135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:38.899139 26135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "3600463f2eba47bb8524da259b6ecfaf"
format_stamp: "Formatted at 2026-08-07 06:56:38 on dist-test-slave-tfpf"
server_key: "55bc497c4758e3becee193d2bac62f5e"
server_key_iv: "3d773979488c30b3fc8774ec29d93b2b"
server_key_version: "encryptionkey@0"
I20260807 06:56:38.899861 26135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "3600463f2eba47bb8524da259b6ecfaf"
format_stamp: "Formatted at 2026-08-07 06:56:38 on dist-test-slave-tfpf"
server_key: "55bc497c4758e3becee193d2bac62f5e"
server_key_iv: "3d773979488c30b3fc8774ec29d93b2b"
server_key_version: "encryptionkey@0"
I20260807 06:56:38.904731 26135 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260807 06:56:38.907994 26157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:38.909341 26135 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:56:38.909507 26135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "3600463f2eba47bb8524da259b6ecfaf"
format_stamp: "Formatted at 2026-08-07 06:56:38 on dist-test-slave-tfpf"
server_key: "55bc497c4758e3becee193d2bac62f5e"
server_key_iv: "3d773979488c30b3fc8774ec29d93b2b"
server_key_version: "encryptionkey@0"
I20260807 06:56:38.909710 26135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:38.926584 26135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:38.930953 26135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:38.931242 26135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:38.932170 26135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:38.933622 26135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:38.933720 26135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:38.933871 26135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:38.933940 26135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:38.975652 26135 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:46667
I20260807 06:56:38.975714 26308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:46667 every 8 connection(s)
I20260807 06:56:38.977447 26135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:56:38.979713 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 26135
I20260807 06:56:38.979925 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:56:38.980345 11006 external_mini_cluster.cc:1428] Setting key 7f9663566d72c994e4cbb9f890ec0574
Aug 07 06:56:38 dist-test-slave-tfpf krb5kdc[25811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085798, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:56:39.003305 26313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:38.981449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:40357 (local address 127.10.191.190:39457)
0807 06:56:38.981897 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:38.981901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:38.983369 (+ 1468us) server_negotiation.cc:407] Connection header received
0807 06:56:38.986241 (+ 2872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:38.986245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:38.986313 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:38.986404 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:38.988631 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:38.989474 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:38.991893 (+ 2419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:38.992280 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:38.992373 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:38.996712 (+ 4339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:38.996718 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:38.996721 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:38.996778 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:39.000010 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:39.000810 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:39.000818 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:39.000824 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:39.000976 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:39.001458 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:39.001463 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:39.001466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:39.001770 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:39.001934 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.002675 (+ 741us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.002929 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":245,"threads_started":1}
I20260807 06:56:39.004360 26314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:38.982243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:39457 (local address 127.10.191.130:40357)
0807 06:56:38.983180 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:38.983239 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:38.985955 (+ 2716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:38.986714 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:38.986728 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:38.987568 (+ 840us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:38.988414 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:38.988443 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:38.989629 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:38.989636 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:38.991745 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:38.991762 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:38.992525 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:38.992534 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:38.992843 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:38.993606 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:38.993640 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:38.996417 (+ 2777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:39.000204 (+ 3787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:39.000213 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:39.000236 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:39.000677 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:39.001119 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:39.001124 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:39.001128 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:39.001336 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:39.001907 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:39.001915 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:39.002301 (+ 386us) client_negotiation.cc:769] Sending connection context
0807 06:56:39.002569 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 06:56:39.003149 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":361,"threads_started":1}
I20260807 06:56:39.005854 26309 heartbeater.cc:347] Connected to a master server at 127.10.191.190:39457
I20260807 06:56:39.006249 26309 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:39.007025 26309 heartbeater.cc:511] Master 127.10.191.190:39457 requested a full tablet report, sending...
I20260807 06:56:39.008677 25881 ts_manager.cc:194] Registered new tserver with Master: 3600463f2eba47bb8524da259b6ecfaf (127.10.191.130:46667)
I20260807 06:56:39.009981 25881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:40357
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:56:39.049237 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:39457
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:56:39.391574 26317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:56:39.391852 26317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:56:39.391942 26317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:56:39.398926 26317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:56:39.399045 26317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:56:39.399170 26317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:56:39.408692 26317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:39457
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:56:39.410120 26317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:56:39.411404 26317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:56:39.424769 26326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:39.424723 26324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:56:39.424813 26323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:56:39.425807 26317 server_base.cc:1034] running on GCE node
I20260807 06:56:39.426402 26317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:56:39.427448 26317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:56:39.428663 26317 hybrid_clock.cc:648] HybridClock initialized: now 1786085799428619 us; error 31 us; skew 500 ppm
I20260807 06:56:39.428957 26317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:56:39 dist-test-slave-tfpf krb5kdc[25811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085799, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:56:39.435111 26317 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:56:39.436474 26317 webserver.cc:460] Webserver started at http://127.10.191.131:37727/ using document root <none> and password file <none>
I20260807 06:56:39.437281 26317 fs_manager.cc:359] Metadata directory not provided
I20260807 06:56:39.437402 26317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:56:39.437674 26317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:56:39.440605 26317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "74fb0470f2c247ab81e609af9f06d40b"
format_stamp: "Formatted at 2026-08-07 06:56:39 on dist-test-slave-tfpf"
server_key: "a46c618e9fc617ce77280f461916135b"
server_key_iv: "6151812e165d9aa6527bdc529de04a6b"
server_key_version: "encryptionkey@0"
I20260807 06:56:39.441413 26317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "74fb0470f2c247ab81e609af9f06d40b"
format_stamp: "Formatted at 2026-08-07 06:56:39 on dist-test-slave-tfpf"
server_key: "a46c618e9fc617ce77280f461916135b"
server_key_iv: "6151812e165d9aa6527bdc529de04a6b"
server_key_version: "encryptionkey@0"
I20260807 06:56:39.446770 26317 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 06:56:39.450142 26337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:39.451521 26317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:56:39.451713 26317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "74fb0470f2c247ab81e609af9f06d40b"
format_stamp: "Formatted at 2026-08-07 06:56:39 on dist-test-slave-tfpf"
server_key: "a46c618e9fc617ce77280f461916135b"
server_key_iv: "6151812e165d9aa6527bdc529de04a6b"
server_key_version: "encryptionkey@0"
I20260807 06:56:39.451934 26317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:56:39.467630 26317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:56:39.471500 26317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:56:39.471812 26317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:56:39.472743 26317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:56:39.474166 26317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:56:39.474282 26317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:39.474439 26317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:56:39.474521 26317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:56:39.479563 26128 heartbeater.cc:503] Master 127.10.191.190:39457 was elected leader, sending a full tablet report...
I20260807 06:56:39.508249 26317 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:39445
I20260807 06:56:39.508296 26509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:39445 every 8 connection(s)
I20260807 06:56:39.509693 26317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:56:39.511654 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 26317
I20260807 06:56:39.511875 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:56:39.512382 11006 external_mini_cluster.cc:1428] Setting key 8e464ba4b5ec3de45d02256c333c3971
Aug 07 06:56:39 dist-test-slave-tfpf krb5kdc[25811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085799, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:56:39.530160 26515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.512759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:54071 (local address 127.10.191.190:39457)
0807 06:56:39.513354 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:39.513360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:39.514476 (+ 1116us) server_negotiation.cc:407] Connection header received
0807 06:56:39.516386 (+ 1910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:39.516390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:39.516454 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:39.516545 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:39.518113 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.518908 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.520343 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.520735 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.520832 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.524117 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:39.524122 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:39.524125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:39.524176 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:39.527252 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:39.528198 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:39.528202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:39.528204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:39.528326 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:39.528745 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:39.528748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:39.528750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:39.528992 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:39.529157 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.529754 (+ 597us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.529909 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":306,"threads_started":1}
I20260807 06:56:39.531071 26516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.513372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:39457 (local address 127.10.191.131:54071)
0807 06:56:39.514292 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:39.514345 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:39.516068 (+ 1723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:39.516784 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:39.516792 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:39.517394 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:56:39.517962 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.517980 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.519040 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.519043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.520146 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.520158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.520927 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.520931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.521199 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.521849 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:56:39.521872 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:56:39.523934 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:56:39.527442 (+ 3508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:39.527452 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:39.527469 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:39.528064 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:39.528422 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:56:39.528425 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:56:39.528428 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:56:39.528649 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:56:39.529132 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:56:39.529137 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:56:39.529443 (+ 306us) client_negotiation.cc:769] Sending connection context
0807 06:56:39.529652 (+ 209us) client_negotiation.cc:240] Negotiation successful
0807 06:56:39.530022 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":374,"threads_started":1}
I20260807 06:56:39.532389 26513 heartbeater.cc:347] Connected to a master server at 127.10.191.190:39457
I20260807 06:56:39.532734 26513 heartbeater.cc:464] Registering TS with master...
I20260807 06:56:39.533550 26513 heartbeater.cc:511] Master 127.10.191.190:39457 requested a full tablet report, sending...
I20260807 06:56:39.534945 25881 ts_manager.cc:194] Registered new tserver with Master: 74fb0470f2c247ab81e609af9f06d40b (127.10.191.131:39445)
I20260807 06:56:39.535720 25881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:54071
I20260807 06:56:39.540208 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:56:39.557183 26515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.544585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45286 (local address 127.10.191.190:39457)
0807 06:56:39.544774 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:39.544783 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:39.545269 (+ 486us) server_negotiation.cc:407] Connection header received
0807 06:56:39.545473 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:39.545478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:39.545559 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:39.545680 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:39.547104 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.547874 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.549185 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.549617 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.549757 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.552057 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:39.552063 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:39.552074 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:39.552105 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:39.554535 (+ 2430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:39.555264 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:39.555269 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:39.555272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:39.555393 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:39.555749 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:39.555753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:39.555756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:39.556158 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:39.556407 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.556705 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.556890 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:56:39.560992 25881 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:56:39.567879 25881 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:56:39.591852 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.580383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44068 (local address 127.10.191.129:35223)
0807 06:56:39.583547 (+ 3164us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:39.583557 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:39.583590 (+ 33us) server_negotiation.cc:407] Connection header received
0807 06:56:39.583701 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:39.583712 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:39.583974 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:39.584231 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:39.585230 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.586662 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.589410 (+ 2748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.590745 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.590943 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.591119 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.591373 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.591527 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2976,"thread_start_us":2816,"threads_started":1}
I20260807 06:56:39.591893 26539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.579894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:35223 (local address 127.0.0.1:44068)
0807 06:56:39.581654 (+ 1760us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:39.581696 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:39.581881 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:39.584197 (+ 2316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:39.584202 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:39.584251 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:39.584927 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.584947 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.586819 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.586823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.589208 (+ 2385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.589221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.590940 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.590946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.591128 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.591187 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 06:56:39.591324 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 06:56:39.591508 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1487,"mutex_wait_us":40,"thread_start_us":4818,"threads_started":1}
I20260807 06:56:39.592118 26535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.580485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37844 (local address 127.10.191.130:46667)
0807 06:56:39.581054 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:39.581100 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:39.582954 (+ 1854us) server_negotiation.cc:407] Connection header received
0807 06:56:39.583199 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:39.583207 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:39.583460 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:39.583635 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:39.584562 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.586188 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.589376 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.590809 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.590963 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.591117 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.591644 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.591824 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":1119,"threads_started":1}
I20260807 06:56:39.592797 26532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.580892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39445 (local address 127.0.0.1:33534)
0807 06:56:39.585116 (+ 4224us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:39.585135 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:39.585293 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:39.586149 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:39.586153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:39.586179 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:39.586664 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.586683 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.588061 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.588067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.590108 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.590124 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.592006 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.592011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.592188 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.592218 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 06:56:39.592309 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 06:56:39.592442 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4060,"mutex_wait_us":69,"thread_start_us":914,"threads_started":1}
I20260807 06:56:39.592808 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.581460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33534 (local address 127.10.191.131:39445)
0807 06:56:39.582484 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:39.582492 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:39.585254 (+ 2762us) server_negotiation.cc:407] Connection header received
0807 06:56:39.585463 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:39.585468 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:39.585644 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:39.585837 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:39.586882 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.587912 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.590294 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.591569 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.591736 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.591868 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.592355 (+ 487us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.592521 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":863,"thread_start_us":908,"threads_started":1}
I20260807 06:56:39.593304 26534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.580164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:46667 (local address 127.0.0.1:37844)
0807 06:56:39.582839 (+ 2675us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:39.582852 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:39.582991 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:39.583895 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:39.583900 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:39.583922 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:39.584336 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.584363 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.586344 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.586353 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.589198 (+ 2845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.589214 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.591264 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.591270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.591437 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.591468 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:56:39.592726 (+ 1258us) client_negotiation.cc:240] Negotiation successful
0807 06:56:39.592877 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2585,"mutex_wait_us":54,"thread_start_us":2476,"threads_started":1}
I20260807 06:56:39.596501 26412 tablet_service.cc:1467] Processing CreateTablet for tablet c4a90b0bd84f49f9a0b5f5aa74130032 (DEFAULT_TABLE table=test-table [id=02e93ea899aa4efd92c04200973bed8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:39.596519 26040 tablet_service.cc:1467] Processing CreateTablet for tablet c4a90b0bd84f49f9a0b5f5aa74130032 (DEFAULT_TABLE table=test-table [id=02e93ea899aa4efd92c04200973bed8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:39.596731 26221 tablet_service.cc:1467] Processing CreateTablet for tablet c4a90b0bd84f49f9a0b5f5aa74130032 (DEFAULT_TABLE table=test-table [id=02e93ea899aa4efd92c04200973bed8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:56:39.597918 26412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4a90b0bd84f49f9a0b5f5aa74130032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:39.598028 26040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4a90b0bd84f49f9a0b5f5aa74130032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:39.598029 26221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4a90b0bd84f49f9a0b5f5aa74130032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:56:39.609292 26542 tablet_bootstrap.cc:492] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: Bootstrap starting.
I20260807 06:56:39.613190 26543 tablet_bootstrap.cc:492] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: Bootstrap starting.
I20260807 06:56:39.613974 26542 tablet_bootstrap.cc:654] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:39.614077 26545 tablet_bootstrap.cc:492] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: Bootstrap starting.
I20260807 06:56:39.615317 26542 log.cc:824] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:39.616660 26543 tablet_bootstrap.cc:654] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:39.616974 26545 tablet_bootstrap.cc:654] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: Neither blocks nor log segments found. Creating new log.
I20260807 06:56:39.617991 26545 log.cc:824] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:39.618048 26543 log.cc:824] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: Log is configured to *not* fsync() on all Append() calls
I20260807 06:56:39.619159 26542 tablet_bootstrap.cc:492] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: No bootstrap required, opened a new log
I20260807 06:56:39.619518 26542 ts_tablet_manager.cc:1397] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260807 06:56:39.622471 26545 tablet_bootstrap.cc:492] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: No bootstrap required, opened a new log
I20260807 06:56:39.622471 26543 tablet_bootstrap.cc:492] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: No bootstrap required, opened a new log
I20260807 06:56:39.622753 26545 ts_tablet_manager.cc:1397] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 06:56:39.622753 26543 ts_tablet_manager.cc:1397] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260807 06:56:39.627455 26542 raft_consensus.cc:348] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } }
I20260807 06:56:39.627892 26542 raft_consensus.cc:374] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:39.627996 26542 raft_consensus.cc:729] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74fb0470f2c247ab81e609af9f06d40b, State: Initialized, Role: FOLLOWER
I20260807 06:56:39.628688 26542 consensus_queue.cc:260] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } }
I20260807 06:56:39.629905 26513 heartbeater.cc:503] Master 127.10.191.190:39457 was elected leader, sending a full tablet report...
I20260807 06:56:39.630787 26542 ts_tablet_manager.cc:1428] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: Time spent starting tablet: real 0.011s user 0.006s sys 0.005s
I20260807 06:56:39.633706 26545 raft_consensus.cc:348] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } }
I20260807 06:56:39.633706 26543 raft_consensus.cc:348] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } }
I20260807 06:56:39.634173 26545 raft_consensus.cc:374] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:39.634174 26543 raft_consensus.cc:374] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:56:39.634286 26545 raft_consensus.cc:729] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d35bef565148492a81bec0c9de3d3a5f, State: Initialized, Role: FOLLOWER
I20260807 06:56:39.634276 26543 raft_consensus.cc:729] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3600463f2eba47bb8524da259b6ecfaf, State: Initialized, Role: FOLLOWER
I20260807 06:56:39.634922 26545 consensus_queue.cc:260] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } }
I20260807 06:56:39.634922 26543 consensus_queue.cc:260] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } }
I20260807 06:56:39.636686 26309 heartbeater.cc:503] Master 127.10.191.190:39457 was elected leader, sending a full tablet report...
I20260807 06:56:39.636857 26545 ts_tablet_manager.cc:1428] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260807 06:56:39.637251 26543 ts_tablet_manager.cc:1428] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: Time spent starting tablet: real 0.014s user 0.012s sys 0.004s
W20260807 06:56:39.696909 26130 tablet.cc:2369] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:56:39.730007 26312 tablet.cc:2369] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:56:39.761482 26514 tablet.cc:2369] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:56:39.835079 26552 raft_consensus.cc:482] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:56:39.835402 26552 raft_consensus.cc:504] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } }
I20260807 06:56:39.837164 26552 leader_election.cc:288] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d35bef565148492a81bec0c9de3d3a5f (127.10.191.129:35223), 74fb0470f2c247ab81e609af9f06d40b (127.10.191.131:39445)
I20260807 06:56:39.844484 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.837567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:41071 (local address 127.10.191.129:35223)
0807 06:56:39.837814 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:39.837823 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:39.838564 (+ 741us) server_negotiation.cc:407] Connection header received
0807 06:56:39.838766 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:39.838771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:39.838829 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:39.838924 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:39.839549 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.840469 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.842517 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.843483 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.843609 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.843661 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.844079 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.844217 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:56:39.844497 26555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.837718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:35223 (local address 127.10.191.130:41071)
0807 06:56:39.838428 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:39.838444 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:39.838599 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:39.838951 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:39.838955 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:39.838984 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:39.839356 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.839368 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.840611 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.840616 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.842353 (+ 1737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.842366 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.843714 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.843722 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.843897 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.843933 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 06:56:39.844028 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 06:56:39.844162 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":1064,"threads_started":1}
I20260807 06:56:39.844980 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.837782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:39141 (local address 127.10.191.131:39445)
0807 06:56:39.837972 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:39.837976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:39.839221 (+ 1245us) server_negotiation.cc:407] Connection header received
0807 06:56:39.839325 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:39.839331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:39.839426 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:39.839520 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:56:39.840134 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.841022 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.842990 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.843912 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.844074 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.844142 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.844568 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.844708 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 06:56:39.845139 26554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.837766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39445 (local address 127.10.191.130:39141)
0807 06:56:39.839099 (+ 1333us) negotiation.cc:107] Waiting for socket to connect
0807 06:56:39.839112 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:56:39.839220 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:56:39.839560 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:56:39.839564 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:56:39.839589 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:56:39.839983 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.839994 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.841191 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.841195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.842798 (+ 1603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:56:39.842811 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.844169 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.844176 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:56:39.844357 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.844388 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:56:39.844522 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 06:56:39.844797 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1211,"thread_start_us":378,"threads_started":1}
I20260807 06:56:39.845721 26067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a90b0bd84f49f9a0b5f5aa74130032" candidate_uuid: "3600463f2eba47bb8524da259b6ecfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d35bef565148492a81bec0c9de3d3a5f" is_pre_election: true
I20260807 06:56:39.846293 26067 raft_consensus.cc:2454] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3600463f2eba47bb8524da259b6ecfaf in term 0.
I20260807 06:56:39.846216 26441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a90b0bd84f49f9a0b5f5aa74130032" candidate_uuid: "3600463f2eba47bb8524da259b6ecfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74fb0470f2c247ab81e609af9f06d40b" is_pre_election: true
I20260807 06:56:39.846719 26441 raft_consensus.cc:2454] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3600463f2eba47bb8524da259b6ecfaf in term 0.
I20260807 06:56:39.846985 26160 leader_election.cc:302] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3600463f2eba47bb8524da259b6ecfaf, d35bef565148492a81bec0c9de3d3a5f; no voters:
I20260807 06:56:39.847426 26552 raft_consensus.cc:2781] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:56:39.847586 26552 raft_consensus.cc:482] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:56:39.847707 26552 raft_consensus.cc:3037] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:39.849902 26552 raft_consensus.cc:504] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } }
I20260807 06:56:39.850526 26552 leader_election.cc:288] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [CANDIDATE]: Term 1 election: Requested vote from peers d35bef565148492a81bec0c9de3d3a5f (127.10.191.129:35223), 74fb0470f2c247ab81e609af9f06d40b (127.10.191.131:39445)
I20260807 06:56:39.850942 26067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a90b0bd84f49f9a0b5f5aa74130032" candidate_uuid: "3600463f2eba47bb8524da259b6ecfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d35bef565148492a81bec0c9de3d3a5f"
I20260807 06:56:39.851016 26441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a90b0bd84f49f9a0b5f5aa74130032" candidate_uuid: "3600463f2eba47bb8524da259b6ecfaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74fb0470f2c247ab81e609af9f06d40b"
I20260807 06:56:39.851202 26441 raft_consensus.cc:3037] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:39.851186 26067 raft_consensus.cc:3037] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:56:39.854470 26067 raft_consensus.cc:2454] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3600463f2eba47bb8524da259b6ecfaf in term 1.
I20260807 06:56:39.854470 26441 raft_consensus.cc:2454] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3600463f2eba47bb8524da259b6ecfaf in term 1.
I20260807 06:56:39.854939 26160 leader_election.cc:302] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3600463f2eba47bb8524da259b6ecfaf, d35bef565148492a81bec0c9de3d3a5f; no voters:
I20260807 06:56:39.855255 26552 raft_consensus.cc:2781] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:56:39.855782 26552 raft_consensus.cc:686] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 1 LEADER]: Becoming Leader. State: Replica: 3600463f2eba47bb8524da259b6ecfaf, State: Running, Role: LEADER
I20260807 06:56:39.856372 26552 consensus_queue.cc:237] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } }
I20260807 06:56:39.861512 25877 catalog_manager.cc:5495] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3600463f2eba47bb8524da259b6ecfaf (127.10.191.130). New cstate: current_term: 1 leader_uuid: "3600463f2eba47bb8524da259b6ecfaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3600463f2eba47bb8524da259b6ecfaf" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 } health_report { overall_health: UNKNOWN } } }
I20260807 06:56:39.888103 26535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.883132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37846 (local address 127.10.191.130:46667)
0807 06:56:39.883375 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:39.883379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:39.883396 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:56:39.883563 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:39.883566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:39.883641 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:39.883784 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:56:39.884099 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.884779 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.886022 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.886429 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.886523 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.886952 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:56:39.887472 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:56:39.887584 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.887695 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.887762 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:56:39.896515 26067 raft_consensus.cc:1261] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [term 1 FOLLOWER]: Refusing update from remote peer 3600463f2eba47bb8524da259b6ecfaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:39.896515 26441 raft_consensus.cc:1261] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [term 1 FOLLOWER]: Refusing update from remote peer 3600463f2eba47bb8524da259b6ecfaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:56:39.897646 26556 consensus_queue.cc:1035] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d35bef565148492a81bec0c9de3d3a5f" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:39.898026 26552 consensus_queue.cc:1035] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74fb0470f2c247ab81e609af9f06d40b" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:56:39.908179 26559 mvcc.cc:205] Tried to move back new op lower bound from 7315807436364804096 to 7315807436215984128. Current Snapshot: MvccSnapshot[applied={T|T < 7315807436364804096}]
I20260807 06:56:39.911358 26562 mvcc.cc:205] Tried to move back new op lower bound from 7315807436364804096 to 7315807436215984128. Current Snapshot: MvccSnapshot[applied={T|T < 7315807436364804096}]
I20260807 06:56:39.911643 26561 mvcc.cc:205] Tried to move back new op lower bound from 7315807436364804096 to 7315807436215984128. Current Snapshot: MvccSnapshot[applied={T|T < 7315807436364804096}]
I20260807 06:56:39.923403 25881 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:39.923724 25881 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:56:39.927865 25881 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b1afd10e6f24eb390c1388365eeb5d9: Sending DeleteTablet for 3 replicas of tablet c4a90b0bd84f49f9a0b5f5aa74130032
I20260807 06:56:39.929011 26221 tablet_service.cc:1514] Processing DeleteTablet for tablet c4a90b0bd84f49f9a0b5f5aa74130032 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:39 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:37844
I20260807 06:56:39.929026 26040 tablet_service.cc:1514] Processing DeleteTablet for tablet c4a90b0bd84f49f9a0b5f5aa74130032 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:39 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:44068
I20260807 06:56:39.929332 26412 tablet_service.cc:1514] Processing DeleteTablet for tablet c4a90b0bd84f49f9a0b5f5aa74130032 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:56:39 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:33534
I20260807 06:56:39.930994 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 25962
I20260807 06:56:39.940003 26575 tablet_replica.cc:330] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: stopping tablet replica
I20260807 06:56:39.941210 26575 raft_consensus.cc:2229] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:39.942413 26575 raft_consensus.cc:2258] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:39.943337 26574 tablet_replica.cc:330] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: stopping tablet replica
I20260807 06:56:39.944237 26574 raft_consensus.cc:2229] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:56:39.944824 26574 raft_consensus.cc:2258] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:39.945935 26573 tablet_replica.cc:330] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: stopping tablet replica
I20260807 06:56:39.946403 26573 raft_consensus.cc:2229] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:56:39.946669 26575 ts_tablet_manager.cc:1905] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:39.947207 26573 raft_consensus.cc:2258] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:56:39.949151 26574 ts_tablet_manager.cc:1905] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:56:39.953121 26573 ts_tablet_manager.cc:1905] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 06:56:39 dist-test-slave-tfpf krb5kdc[25811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:56:39.953979 26575 ts_tablet_manager.cc:1918] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:56:39.954144 26575 log.cc:1196] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/c4a90b0bd84f49f9a0b5f5aa74130032
I20260807 06:56:39.954655 26575 ts_tablet_manager.cc:1939] T c4a90b0bd84f49f9a0b5f5aa74130032 P 74fb0470f2c247ab81e609af9f06d40b: Deleting consensus metadata
I20260807 06:56:39.955922 26574 ts_tablet_manager.cc:1918] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:56:39.956110 26574 log.cc:1196] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/c4a90b0bd84f49f9a0b5f5aa74130032
I20260807 06:56:39.956653 26574 ts_tablet_manager.cc:1939] T c4a90b0bd84f49f9a0b5f5aa74130032 P d35bef565148492a81bec0c9de3d3a5f: Deleting consensus metadata
I20260807 06:56:39.956876 25859 catalog_manager.cc:4841] TS 74fb0470f2c247ab81e609af9f06d40b (127.10.191.131:39445): tablet c4a90b0bd84f49f9a0b5f5aa74130032 (table test-table [id=02e93ea899aa4efd92c04200973bed8f]) successfully deleted
I20260807 06:56:39.961442 26573 ts_tablet_manager.cc:1918] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:56:39.961732 26573 log.cc:1196] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/c4a90b0bd84f49f9a0b5f5aa74130032
I20260807 06:56:39.962013 26537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:39.933180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44080 (local address 127.10.191.129:35223)
0807 06:56:39.933364 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:39.933372 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:39.943386 (+ 10014us) server_negotiation.cc:407] Connection header received
0807 06:56:39.943949 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:39.943958 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:39.944054 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:39.944138 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:39.946083 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.947096 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.948932 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:39.949638 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:39.949742 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:39.955254 (+ 5512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:39.955269 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:39.955286 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:39.955326 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:39.959237 (+ 3911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:39.959879 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:39.959888 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:39.959891 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:39.960024 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:39.960395 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:39.960399 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:39.960402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:39.960747 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:39.961045 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:39.961387 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 06:56:39.961620 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 06:56:39.962370 26573 ts_tablet_manager.cc:1939] T c4a90b0bd84f49f9a0b5f5aa74130032 P 3600463f2eba47bb8524da259b6ecfaf: Deleting consensus metadata
I20260807 06:56:39.962702 26123 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:39.964346 25857 catalog_manager.cc:4841] TS 3600463f2eba47bb8524da259b6ecfaf (127.10.191.130:46667): tablet c4a90b0bd84f49f9a0b5f5aa74130032 (table test-table [id=02e93ea899aa4efd92c04200973bed8f]) successfully deleted
I20260807 06:56:40.051419 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 25962
I20260807 06:56:40.051546 25855 catalog_manager.cc:4841] TS d35bef565148492a81bec0c9de3d3a5f (127.10.191.129:35223): tablet c4a90b0bd84f49f9a0b5f5aa74130032 (table test-table [id=02e93ea899aa4efd92c04200973bed8f]) successfully deleted
I20260807 06:56:40.088277 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 26135
Aug 07 06:56:40 dist-test-slave-tfpf krb5kdc[25811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:56:40.105295 26535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:40.089156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37852 (local address 127.10.191.130:46667)
0807 06:56:40.089346 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:40.089352 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:40.089506 (+ 154us) server_negotiation.cc:407] Connection header received
0807 06:56:40.089734 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:40.089738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:40.089806 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:40.089934 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:40.091188 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:40.092027 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:40.093623 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:40.094031 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:40.094174 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:40.098414 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:40.098430 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:40.098449 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:40.098490 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:40.101714 (+ 3224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:40.102453 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:40.102461 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:40.102463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:40.102638 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:40.103056 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:40.103060 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:40.103062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:40.103419 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:40.103775 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:40.104670 (+ 895us) server_negotiation.cc:299] Negotiation successful
0807 06:56:40.104894 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:56:40.106148 26298 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:40.218851 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 26135
I20260807 06:56:40.248277 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 26317
Aug 07 06:56:40 dist-test-slave-tfpf krb5kdc[25811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:56:40.263177 26541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:56:40.249154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33542 (local address 127.10.191.131:39445)
0807 06:56:40.249323 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 06:56:40.249327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:56:40.249346 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:56:40.249521 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:56:40.249525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:56:40.249598 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:56:40.249682 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:56:40.250925 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:40.251624 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:40.252782 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:56:40.253266 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:56:40.253387 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:56:40.257926 (+ 4539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:56:40.257939 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:56:40.257957 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:56:40.258074 (+ 117us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:56:40.260749 (+ 2675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:40.261442 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:40.261448 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:40.261451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:40.261604 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:56:40.261907 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:56:40.261910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:56:40.261911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:56:40.262238 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:56:40.262455 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0807 06:56:40.262750 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 06:56:40.262913 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:56:40.264025 26503 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:40.349897 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 26317
I20260807 06:56:40.375021 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 25829
I20260807 06:56:40.376227 25922 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:56:40.482791 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 25829
2026-08-07T06:56:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4710 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:56:40 dist-test-slave-tfpf krb5kdc[26585](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:56:40 dist-test-slave-tfpf krb5kdc[26585](info): set up 2 sockets
Aug 07 06:56:40 dist-test-slave-tfpf krb5kdc[26585](info): commencing operation
krb5kdc: starting...
W20260807 06:56:41.774219 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:56:41 dist-test-slave-tfpf krb5kdc[26585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:56:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:56:41Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.191.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.191.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/rangeradmin_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/rangeradmin_127.10.191.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.191.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.191.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/rangerlookup_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/rangerlookup_127.10.191.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.191.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.191.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/HTTP_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/HTTP_127.10.191.148@KRBTEST.COM.keytab.
I20260807 06:56:42.198050 11006 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskHuszJs/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/postgres -l logfile start
2026-08-07 06:56:44.503 UTC [26628] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 06:56:44.503 UTC [26628] LOG: listening on IPv4 address "127.10.191.148", port 49287
2026-08-07 06:56:44.506 UTC [26628] LOG: listening on Unix socket "/tmp/.s.PGSQL.49287"
2026-08-07 06:56:44.526 UTC [26630] LOG: database system was shut down at 2026-08-07 06:56:43 UTC
2026-08-07 06:56:44.530 UTC [26628] LOG: database system is ready to accept connections
I20260807 06:56:45.650135 11006 mini_postgres.cc:96] Postgres bound to 49287
2026-08-07 06:56:45.678 UTC [26646] FATAL: database "slave" does not exist
127.10.191.148:49287 - accepting connections
I20260807 06:56:45.678969 11006 mini_ranger.cc:161] Starting Ranger...
I20260807 06:56:45.711582 11006 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 06:56:46.126618 11006 mini_ranger.cc:87] Created ranger Postgres database
I20260807 06:56:46.126776 11006 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-admin
2026-08-07 06:56:46,529 [I] DB FLAVOR :POSTGRES
2026-08-07 06:56:46,530 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:56:46,530 [I] Checking connection..
2026-08-07 06:56:46,530 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 06:56:46,802 [I] Checking connection passed.
2026-08-07 06:56:46,803 [I] --------- Verifying version history table ---------
2026-08-07 06:56:46,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:56:47,071 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:56:47,072 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:56:47,352 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:56:47,352 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 06:56:47,352 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 06:56:47.597 UTC [26737] WARNING: there is no transaction in progress
2026-08-07 06:56:47,604 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 06:56:47,605 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:56:47,873 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 06:56:47,873 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:56:47,873 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 06:56:48,121 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 06:56:48,387 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tfpf.c.gcp-upstream.internal','N') ;"
2026-08-07 06:56:48,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:56:48,884 [I] Table x_portal_user does not exist in database ranger
2026-08-07 06:56:48,884 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:56:49,139 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 06:56:49,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:56:49,409 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:56:49,676 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 06:56:49,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 06:56:50.591 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.606 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.621 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.635 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.650 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.666 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.717 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.724 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.737 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.746 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.755 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.769 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.777 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.783 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.789 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:50.794 UTC [26881] WARNING: there is no transaction in progress
2026-08-07 06:56:51,326 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 06:56:51,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 06:56:51,571 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 06:56:51,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:56:51,831 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 06:56:51,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:56:52,089 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 06:56:52,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:56:52,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:56:52,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tfpf.c.gcp-upstream.internal';"
2026-08-07 06:56:52,840 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 06:56:52,840 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 06:56:53,080 [I] DB_PATCHES have already been applied
I20260807 06:56:53.086131 11006 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-admin:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskHuszJs/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 06:56:53.086259 11006 mini_ranger.cc:193] Using host: 127.10.191.148
I20260807 06:56:53.111078 11006 mini_ranger.cc:227] Ranger admin URL: http://127.10.191.148:41199
Aug 07, 2026 6:56:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:56:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:56:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 6:56:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 6:56:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 6:56:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 6:56:54 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 06:56:54.471472 11006 mini_ranger.cc:160] Time spent starting Ranger: real 8.793s user 0.000s sys 0.076s
Aug 07, 2026 6:57:15 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 6:57:15 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 07, 2026 6:57:15 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 6:57:15 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 6:57:16 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 06:57:17.070449 11006 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.191.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.191.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/rangerkms_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/rangerkms_127.10.191.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.191.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.191.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.191.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/HTTP_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.191.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/HTTP_127.10.191.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 06:57:17 dist-test-slave-tfpf krb5kdc[26585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085837, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 06:57:17.309383 11006 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 06:57:17.343461 11006 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 06:57:18.070992 11006 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 06:57:18.071182 11006 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-kms
I20260807 06:57:18.071312 11006 mini_ranger_kms.cc:227] Using postgres at 127.10.191.148:49287
2026-08-07 06:57:18,666 [I] DB FLAVOR :POSTGRES
2026-08-07 06:57:18,666 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:57:18,666 [I] Checking connection
2026-08-07 06:57:18,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 06:57:18,908 [I] connection success
2026-08-07 06:57:18,908 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 06:57:18,909 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 06:57:18,909 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 06:57:19,157 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 06:57:19,158 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:57:19,158 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 06:57:19,158 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:49287/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 06:57:19,420 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 06:57:19.877727 11006 mini_ranger_kms.cc:310] Created kms service
I20260807 06:57:20.038369 11006 mini_ranger_kms.cc:326] Created kudu user
I20260807 06:57:20.091853 11006 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 06:57:20 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085837, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:57:20.521590 11006 mini_ranger_kms.cc:384] Added ranger policy
I20260807 06:57:20.522950 11006 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-kms:/tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 06:57:20.523048 11006 mini_ranger_kms.cc:240] Using host: 127.10.191.148
I20260807 06:57:20.560804 11006 mini_ranger_kms.cc:276] Ranger KMS PID: 27126
I20260807 06:57:20.560997 11006 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.191.148:34037
Aug 07, 2026 6:57:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:57:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:57:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 6:57:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 6:57:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 6:57:21 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 06:57:22 dist-test-slave-tfpf krb5kdc[26585](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085842, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.191.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:57:23.321053 11006 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.012s user 0.151s sys 0.423s
I20260807 06:57:23.321483 11006 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 06:57:23.321750 11006 mini_ranger_kms.cc:401] 127.10.191.148:34037/kms/v1/keys
Aug 07 06:57:23 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085842, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.191.148@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
Aug 07 06:57:23 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085842, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.191.148@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
Aug 07 06:57:26 dist-test-slave-tfpf krb5kdc[26585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:57:26.213132 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:38651
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:38651
--ranger_config_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:34037/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:57:26.580309 27198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:57:26.580677 27198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:57:26.580871 27198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:57:26.588301 27198 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:57:26.588464 27198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:57:26.588570 27198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:57:26.588675 27198 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:57:26.588755 27198 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:57:26.599709 27198 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.191.148:34037/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:38651
--ranger_config_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:38651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:57:26.600900 27198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:57:26.602325 27198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:57:26.615396 27209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:57:26.615495 27207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:57:26.615470 27206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:57:26.616252 27198 server_base.cc:1034] running on GCE node
I20260807 06:57:26.617036 27198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:57:26.618489 27198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:57:26.619716 27198 hybrid_clock.cc:648] HybridClock initialized: now 1786085846619684 us; error 44 us; skew 500 ppm
I20260807 06:57:26.620056 27198 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:57:26 dist-test-slave-tfpf krb5kdc[26585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085846, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:57:26.627295 27198 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:57:26.628787 27198 webserver.cc:460] Webserver started at http://127.10.191.190:36975/ using document root <none> and password file <none>
I20260807 06:57:26.629530 27198 fs_manager.cc:359] Metadata directory not provided
I20260807 06:57:26.629711 27198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:57:26.630049 27198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:57:26 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085846, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:57:26.698890 27198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "d8ae1a2f1dc24acda7880b7215cb506d"
format_stamp: "Formatted at 2026-08-07 06:57:26 on dist-test-slave-tfpf"
server_key: "df57bf2683d57b8935c78540b908709b"
server_key_iv: "a2b15ed76fff781f22c8974d28560c9a"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:26.699970 27198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "d8ae1a2f1dc24acda7880b7215cb506d"
format_stamp: "Formatted at 2026-08-07 06:57:26 on dist-test-slave-tfpf"
server_key: "df57bf2683d57b8935c78540b908709b"
server_key_iv: "a2b15ed76fff781f22c8974d28560c9a"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:26.707221 27198 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260807 06:57:26.727411 27219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:26.729220 27198 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:57:26.729429 27198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "d8ae1a2f1dc24acda7880b7215cb506d"
format_stamp: "Formatted at 2026-08-07 06:57:26 on dist-test-slave-tfpf"
server_key: "df57bf2683d57b8935c78540b908709b"
server_key_iv: "a2b15ed76fff781f22c8974d28560c9a"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:26.729758 27198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:57:26.765149 27198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:57:26.768844 27198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:57:26.769122 27198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:57:26.787863 27198 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:38651
I20260807 06:57:26.787891 27283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:38651 every 8 connection(s)
I20260807 06:57:26.789372 27198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:57:26.793320 27285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:57:26.795037 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 27198
I20260807 06:57:26.795274 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:57:26.795939 11006 external_mini_cluster.cc:1428] Setting key f57d950ca9ff51a31fedaf6a93225ab1
I20260807 06:57:26.806741 27285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d: Bootstrap starting.
I20260807 06:57:26.810642 27285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d: Neither blocks nor log segments found. Creating new log.
Aug 07 06:57:26 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:57:26.812004 27285 log.cc:824] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d: Log is configured to *not* fsync() on all Append() calls
I20260807 06:57:26.815686 27285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d: No bootstrap required, opened a new log
I20260807 06:57:26.820616 27289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:26.798254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49098 (local address 127.10.191.190:38651)
0807 06:57:26.799165 (+ 911us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:26.799181 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:26.799235 (+ 54us) server_negotiation.cc:407] Connection header received
0807 06:57:26.801632 (+ 2397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:26.801661 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:26.802163 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:26.802621 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:57:26.803724 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:26.805735 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:26.807013 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:26.808076 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:26.808275 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:26.812575 (+ 4300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:57:26.812583 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:57:26.812603 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:57:26.812643 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:57:26.816258 (+ 3615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:26.816972 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:26.816982 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:26.816990 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:26.817215 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:26.817569 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:26.817574 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:26.817578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:26.818290 (+ 712us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:57:26.818595 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:26.818922 (+ 327us) server_negotiation.cc:299] Negotiation successful
0807 06:57:26.819352 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":406,"threads_started":1}
I20260807 06:57:26.825266 27285 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ae1a2f1dc24acda7880b7215cb506d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38651 } }
I20260807 06:57:26.825605 27285 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:57:26.825675 27285 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ae1a2f1dc24acda7880b7215cb506d, State: Initialized, Role: FOLLOWER
I20260807 06:57:26.826177 27285 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ae1a2f1dc24acda7880b7215cb506d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38651 } }
I20260807 06:57:26.826382 27285 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:57:26.826475 27285 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:57:26.826601 27285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:57:26.828608 27285 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ae1a2f1dc24acda7880b7215cb506d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38651 } }
I20260807 06:57:26.829061 27285 leader_election.cc:302] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8ae1a2f1dc24acda7880b7215cb506d; no voters:
I20260807 06:57:26.829886 27285 leader_election.cc:288] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:57:26.830041 27291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:57:26.830886 27291 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [term 1 LEADER]: Becoming Leader. State: Replica: d8ae1a2f1dc24acda7880b7215cb506d, State: Running, Role: LEADER
I20260807 06:57:26.831492 27291 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ae1a2f1dc24acda7880b7215cb506d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38651 } }
I20260807 06:57:26.832188 27285 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:57:26.841161 27293 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8ae1a2f1dc24acda7880b7215cb506d. Latest consensus state: current_term: 1 leader_uuid: "d8ae1a2f1dc24acda7880b7215cb506d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ae1a2f1dc24acda7880b7215cb506d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38651 } } }
I20260807 06:57:26.841559 27293 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [sys.catalog]: This master's current role is: LEADER
I20260807 06:57:26.842057 27292 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8ae1a2f1dc24acda7880b7215cb506d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ae1a2f1dc24acda7880b7215cb506d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 38651 } } }
I20260807 06:57:26.842926 27292 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d [sys.catalog]: This master's current role is: LEADER
I20260807 06:57:26.847077 27301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:57:26.849577 27285 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 06:57:26.860538 27301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:57:26.871873 27301 catalog_manager.cc:1347] Generated new cluster ID: 4453a0c701434d6bb8c4a5c7319f3634
I20260807 06:57:26.872004 27301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:57:26.894392 27301 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:57:26.896585 27301 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:57:26.915213 27301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d: Generated new TSK 0
I20260807 06:57:26.916399 27301 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:57:27.698215 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:34037/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38651
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:57:27 dist-test-slave-tfpf krb5kdc[26585](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085847, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 06:57:28.116735 27351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:57:28.117046 27351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:57:28.117245 27351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:57:28.127288 27351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:57:28.127516 27351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:57:28.127734 27351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:57:28.142311 27351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.191.148:34037/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38651
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:57:28.143812 27351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:57:28.145385 27351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:57:28.165169 27363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:57:28.173182 27365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:57:28.173257 27367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:57:28.173761 27351 server_base.cc:1034] running on GCE node
I20260807 06:57:28.174712 27351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:57:28.177127 27351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:57:28.178432 27351 hybrid_clock.cc:648] HybridClock initialized: now 1786085848178356 us; error 66 us; skew 500 ppm
I20260807 06:57:28.178843 27351 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:57:28 dist-test-slave-tfpf krb5kdc[26585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085848, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:57:28.182205 27351 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:57:28.186388 27351 webserver.cc:460] Webserver started at http://127.10.191.129:34685/ using document root <none> and password file <none>
I20260807 06:57:28.187172 27351 fs_manager.cc:359] Metadata directory not provided
I20260807 06:57:28.187322 27351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:57:28.187780 27351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:57:28 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085848, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:57:28.211118 27351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "9cdb8c34dae54148b2a8f7a26e0e855e"
format_stamp: "Formatted at 2026-08-07 06:57:28 on dist-test-slave-tfpf"
server_key: "1a099e065b8b71150022cd14b71a77d7"
server_key_iv: "e451a19a65739054b770170639919c2c"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:28.212859 27351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "9cdb8c34dae54148b2a8f7a26e0e855e"
format_stamp: "Formatted at 2026-08-07 06:57:28 on dist-test-slave-tfpf"
server_key: "1a099e065b8b71150022cd14b71a77d7"
server_key_iv: "e451a19a65739054b770170639919c2c"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:28.232806 27351 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.010s sys 0.007s
I20260807 06:57:28.255484 27379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:28.257527 27351 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 06:57:28.257818 27351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "9cdb8c34dae54148b2a8f7a26e0e855e"
format_stamp: "Formatted at 2026-08-07 06:57:28 on dist-test-slave-tfpf"
server_key: "1a099e065b8b71150022cd14b71a77d7"
server_key_iv: "e451a19a65739054b770170639919c2c"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:28.258213 27351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:57:28.289713 27351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:57:28.294726 27351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:57:28.295166 27351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:57:28.300452 27351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:57:28.302245 27351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:57:28.302356 27351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:28.302515 27351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:57:28.302610 27351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:28.404021 27351 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:38591
I20260807 06:57:28.404070 27533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:38591 every 8 connection(s)
I20260807 06:57:28.405974 27351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:57:28.416146 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 27351
I20260807 06:57:28.416352 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:57:28.417357 11006 external_mini_cluster.cc:1428] Setting key 3023b42c71a15b3f2a08e73e9d305dfd
Aug 07 06:57:28 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085848, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:57:28.442080 27537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:28.408998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:60139 (local address 127.10.191.190:38651)
0807 06:57:28.417502 (+ 8504us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:28.417510 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:28.419424 (+ 1914us) server_negotiation.cc:407] Connection header received
0807 06:57:28.421651 (+ 2227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:28.421657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:28.421753 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:28.421857 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:57:28.424102 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:28.425267 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:28.427746 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:28.428408 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:28.428508 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:28.434465 (+ 5957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:57:28.434472 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:57:28.434477 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:57:28.434524 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:57:28.438254 (+ 3730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:28.439248 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:28.439254 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:28.439258 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:28.439409 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:28.439957 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:28.439962 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:28.439965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:28.440305 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:57:28.440446 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:28.441434 (+ 988us) server_negotiation.cc:299] Negotiation successful
0807 06:57:28.441680 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8344,"thread_start_us":8211,"threads_started":1}
I20260807 06:57:28.443406 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:28.409630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:38651 (local address 127.10.191.129:60139)
0807 06:57:28.418888 (+ 9258us) negotiation.cc:107] Waiting for socket to connect
0807 06:57:28.418951 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 06:57:28.421311 (+ 2360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:57:28.422417 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:57:28.422428 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:57:28.423099 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:57:28.423904 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:28.423928 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:28.425487 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:28.425493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:28.427554 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:28.427571 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:28.428896 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:28.428903 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:28.429254 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:28.431032 (+ 1778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:57:28.431071 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:57:28.434124 (+ 3053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:57:28.438434 (+ 4310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:57:28.438445 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:57:28.438466 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:57:28.439115 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:57:28.439540 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:57:28.439544 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:57:28.439548 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:57:28.439836 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:57:28.440458 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:57:28.440468 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:57:28.440965 (+ 497us) client_negotiation.cc:769] Sending connection context
0807 06:57:28.441346 (+ 381us) client_negotiation.cc:240] Negotiation successful
0807 06:57:28.441934 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8867,"spinlock_wait_cycles":22400,"thread_start_us":8760,"threads_started":1}
I20260807 06:57:28.446854 27534 heartbeater.cc:347] Connected to a master server at 127.10.191.190:38651
I20260807 06:57:28.447187 27534 heartbeater.cc:464] Registering TS with master...
I20260807 06:57:28.448098 27534 heartbeater.cc:511] Master 127.10.191.190:38651 requested a full tablet report, sending...
I20260807 06:57:28.451264 27239 ts_manager.cc:194] Registered new tserver with Master: 9cdb8c34dae54148b2a8f7a26e0e855e (127.10.191.129:38591)
I20260807 06:57:28.453342 27239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:60139
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Aug 07 06:57:28 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085847, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
W20260807 06:57:28.523422 11006 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.191.130: real 0.103s user 0.000s sys 0.027s
I20260807 06:57:28.524212 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:34037/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38651
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:57:28 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085847, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
W20260807 06:57:28.947686 27543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:57:28.948105 27543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:57:28.948311 27543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:57:28.959846 27543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:57:28.960083 27543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:57:28.960310 27543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:57:28.976390 27543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.191.148:34037/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38651
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:57:28.978202 27543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:57:28.979907 27543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:57:29.015460 27552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:57:29.017037 27553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:57:29.019474 27556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:57:29.026736 27543 server_base.cc:1034] running on GCE node
I20260807 06:57:29.027501 27543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:57:29.028761 27543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:57:29.030009 27543 hybrid_clock.cc:648] HybridClock initialized: now 1786085849029937 us; error 59 us; skew 500 ppm
I20260807 06:57:29.030402 27543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:57:29 dist-test-slave-tfpf krb5kdc[26585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085849, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:57:29.034610 27543 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:57:29.042351 27543 webserver.cc:460] Webserver started at http://127.10.191.130:46607/ using document root <none> and password file <none>
I20260807 06:57:29.043292 27543 fs_manager.cc:359] Metadata directory not provided
I20260807 06:57:29.043467 27543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:57:29.043859 27543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:57:29 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085849, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:57:29.069263 27543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "4cf7e1804b724720b13807ca843c5ef5"
format_stamp: "Formatted at 2026-08-07 06:57:29 on dist-test-slave-tfpf"
server_key: "da00caa43586292ae9d9c7d1ee6b2be5"
server_key_iv: "828aea0c9f2166fb1e524c1f531b4bc1"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:29.070362 27543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "4cf7e1804b724720b13807ca843c5ef5"
format_stamp: "Formatted at 2026-08-07 06:57:29 on dist-test-slave-tfpf"
server_key: "da00caa43586292ae9d9c7d1ee6b2be5"
server_key_iv: "828aea0c9f2166fb1e524c1f531b4bc1"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:29.081609 27543 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.010s sys 0.000s
I20260807 06:57:29.100373 27577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:29.102286 27543 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:57:29.102473 27543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "4cf7e1804b724720b13807ca843c5ef5"
format_stamp: "Formatted at 2026-08-07 06:57:29 on dist-test-slave-tfpf"
server_key: "da00caa43586292ae9d9c7d1ee6b2be5"
server_key_iv: "828aea0c9f2166fb1e524c1f531b4bc1"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:29.102742 27543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:57:29.142298 27543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:57:29.147703 27543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:57:29.148159 27543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:57:29.150168 27543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:57:29.153863 27543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:57:29.153957 27543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:29.154141 27543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:57:29.154210 27543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:29.200454 27543 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:39951
I20260807 06:57:29.200477 27744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:39951 every 8 connection(s)
I20260807 06:57:29.201864 27543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:57:29.209110 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 27543
I20260807 06:57:29.209296 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:57:29.209867 11006 external_mini_cluster.cc:1428] Setting key f02ae08e1fac0300c3f3edfbc44101cf
Aug 07 06:57:29 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085849, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:57:29.226935 27748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.204717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:54943 (local address 127.10.191.190:38651)
0807 06:57:29.205262 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:29.205267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:29.206396 (+ 1129us) server_negotiation.cc:407] Connection header received
0807 06:57:29.208262 (+ 1866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:29.208268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:29.208372 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:29.208497 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:57:29.210533 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.211822 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.214226 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.215012 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.215160 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.219599 (+ 4439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:57:29.219606 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:57:29.219611 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:57:29.219653 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:57:29.223198 (+ 3545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:29.224161 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:29.224167 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:29.224170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:29.224324 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:29.224852 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:29.224856 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:29.224859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:29.225238 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:57:29.225382 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:29.226340 (+ 958us) server_negotiation.cc:299] Negotiation successful
0807 06:57:29.226559 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":242,"threads_started":1}
I20260807 06:57:29.228175 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.205458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:38651 (local address 127.10.191.130:54943)
0807 06:57:29.206239 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0807 06:57:29.206276 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:57:29.207987 (+ 1711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:57:29.208803 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:57:29.208815 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:57:29.209469 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:57:29.210325 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.210352 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.212026 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.212032 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.214056 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.214071 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.215263 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.215270 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.215547 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.216409 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:57:29.216438 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:57:29.219330 (+ 2892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:57:29.223355 (+ 4025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:57:29.223367 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:57:29.223387 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:57:29.224014 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:57:29.224441 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:57:29.224448 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:57:29.224454 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:57:29.224724 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:57:29.225387 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:57:29.225398 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:57:29.225852 (+ 454us) client_negotiation.cc:769] Sending connection context
0807 06:57:29.226214 (+ 362us) client_negotiation.cc:240] Negotiation successful
0807 06:57:29.226763 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":314,"threads_started":1}
I20260807 06:57:29.229851 27745 heartbeater.cc:347] Connected to a master server at 127.10.191.190:38651
I20260807 06:57:29.230211 27745 heartbeater.cc:464] Registering TS with master...
I20260807 06:57:29.231101 27745 heartbeater.cc:511] Master 127.10.191.190:38651 requested a full tablet report, sending...
I20260807 06:57:29.232831 27239 ts_manager.cc:194] Registered new tserver with Master: 4cf7e1804b724720b13807ca843c5ef5 (127.10.191.130:39951)
I20260807 06:57:29.233989 27239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:54943
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:57:29.279556 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:34037/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38651
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:38859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:57:29.457087 27534 heartbeater.cc:503] Master 127.10.191.190:38651 was elected leader, sending a full tablet report...
W20260807 06:57:29.624032 27756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:57:29.624300 27756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:57:29.624450 27756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:57:29.631359 27756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:57:29.631491 27756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:57:29.631641 27756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:57:29.642107 27756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:38859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.191.148:34037/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:38651
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:57:29.643586 27756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:57:29.644974 27756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:57:29.658456 27764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:57:29.658556 27762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:57:29.658366 27766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:57:29.659446 27756 server_base.cc:1034] running on GCE node
I20260807 06:57:29.660027 27756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:57:29.660931 27756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:57:29.662171 27756 hybrid_clock.cc:648] HybridClock initialized: now 1786085849662114 us; error 81 us; skew 500 ppm
I20260807 06:57:29.662499 27756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:57:29 dist-test-slave-tfpf krb5kdc[26585](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085849, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:57:29.665903 27756 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:57:29.667312 27756 webserver.cc:460] Webserver started at http://127.10.191.131:45915/ using document root <none> and password file <none>
I20260807 06:57:29.668093 27756 fs_manager.cc:359] Metadata directory not provided
I20260807 06:57:29.668247 27756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:57:29.668579 27756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:57:29 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085849, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:57:29.685801 27756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "7d9ad078c5124082aab4075befec674f"
format_stamp: "Formatted at 2026-08-07 06:57:29 on dist-test-slave-tfpf"
server_key: "698e89aa2d12789f5ba2b7800554a253"
server_key_iv: "1d8d793774cc756b3e31c330aca32133"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:29.686923 27756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "7d9ad078c5124082aab4075befec674f"
format_stamp: "Formatted at 2026-08-07 06:57:29 on dist-test-slave-tfpf"
server_key: "698e89aa2d12789f5ba2b7800554a253"
server_key_iv: "1d8d793774cc756b3e31c330aca32133"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:29.693538 27756 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.007s
I20260807 06:57:29.707919 27774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:29.709431 27756 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:57:29.709622 27756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "7d9ad078c5124082aab4075befec674f"
format_stamp: "Formatted at 2026-08-07 06:57:29 on dist-test-slave-tfpf"
server_key: "698e89aa2d12789f5ba2b7800554a253"
server_key_iv: "1d8d793774cc756b3e31c330aca32133"
server_key_version: "kuduclusterkey@0"
I20260807 06:57:29.709846 27756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:57:29.732440 27756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:57:29.736757 27756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:57:29.737103 27756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:57:29.738155 27756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:57:29.739531 27756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:57:29.739609 27756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:29.739777 27756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:57:29.739828 27756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:57:29.772647 27756 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:44099
I20260807 06:57:29.772687 27938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:44099 every 8 connection(s)
I20260807 06:57:29.774001 27756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:57:29.779907 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 27756
I20260807 06:57:29.780094 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:57:29.780546 11006 external_mini_cluster.cc:1428] Setting key 43a4a380073852b571889daa2f7e8879
Aug 07 06:57:29 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085849, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:57:29.793404 27945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.776383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:33015 (local address 127.10.191.190:38651)
0807 06:57:29.776932 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:29.776937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:29.777675 (+ 738us) server_negotiation.cc:407] Connection header received
0807 06:57:29.779381 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:29.779388 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:29.779475 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:29.779625 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:57:29.781179 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.782166 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.783920 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.784309 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.784431 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.787566 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:57:29.787571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:57:29.787574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:57:29.787606 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:57:29.790332 (+ 2726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:29.791068 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:29.791077 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:29.791080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:29.791208 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:29.791668 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:29.791671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:29.791673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:29.791974 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:57:29.792134 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:29.792776 (+ 642us) server_negotiation.cc:299] Negotiation successful
0807 06:57:29.792999 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":275,"threads_started":1}
I20260807 06:57:29.794399 27947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.776772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:38651 (local address 127.10.191.131:33015)
0807 06:57:29.777520 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0807 06:57:29.777556 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 06:57:29.779124 (+ 1568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:57:29.779836 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:57:29.779843 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:57:29.780375 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:57:29.780965 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.780982 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.782324 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.782329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.783775 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.783793 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.784534 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.784540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.784761 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.785376 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:57:29.785401 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:57:29.787328 (+ 1927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:57:29.790463 (+ 3135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:57:29.790472 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:57:29.790486 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:57:29.790938 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:57:29.791326 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:57:29.791332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:57:29.791335 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:57:29.791538 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:57:29.792115 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:57:29.792122 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:57:29.792425 (+ 303us) client_negotiation.cc:769] Sending connection context
0807 06:57:29.792681 (+ 256us) client_negotiation.cc:240] Negotiation successful
0807 06:57:29.793216 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":336,"threads_started":1}
I20260807 06:57:29.795895 27939 heartbeater.cc:347] Connected to a master server at 127.10.191.190:38651
I20260807 06:57:29.796243 27939 heartbeater.cc:464] Registering TS with master...
I20260807 06:57:29.796968 27939 heartbeater.cc:511] Master 127.10.191.190:38651 requested a full tablet report, sending...
I20260807 06:57:29.798406 27239 ts_manager.cc:194] Registered new tserver with Master: 7d9ad078c5124082aab4075befec674f (127.10.191.131:44099)
I20260807 06:57:29.799299 27239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:33015
I20260807 06:57:29.808650 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:57:29.825857 27945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.813156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49104 (local address 127.10.191.190:38651)
0807 06:57:29.813357 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:29.813364 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:29.813839 (+ 475us) server_negotiation.cc:407] Connection header received
0807 06:57:29.814035 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:29.814042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:29.814122 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:29.814246 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:57:29.815775 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.816491 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.817934 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.818354 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.818496 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.820751 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:57:29.820755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:57:29.820759 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:57:29.820791 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:57:29.823288 (+ 2497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:29.823910 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:29.823916 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:29.823919 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:29.824045 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:29.824410 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:29.824414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:29.824417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:29.824687 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:57:29.824937 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:29.825332 (+ 395us) server_negotiation.cc:299] Negotiation successful
0807 06:57:29.825540 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:57:29.829768 27239 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:57:29.837177 27239 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:57:29.866688 27961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.850125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57494 (local address 127.10.191.129:38591)
0807 06:57:29.858786 (+ 8661us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:29.858793 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:29.858816 (+ 23us) server_negotiation.cc:407] Connection header received
0807 06:57:29.858915 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:29.858921 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:29.859108 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:29.859973 (+ 865us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:57:29.860203 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.861682 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.864127 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.865482 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.865690 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.865866 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:29.866200 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 06:57:29.866350 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8473,"thread_start_us":8308,"threads_started":1}
I20260807 06:57:29.866995 27965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.854159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46862 (local address 127.10.191.130:39951)
0807 06:57:29.855247 (+ 1088us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:29.855258 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:29.858159 (+ 2901us) server_negotiation.cc:407] Connection header received
0807 06:57:29.858364 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:29.858373 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:29.858599 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:29.858788 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:57:29.859827 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.861430 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.864183 (+ 2753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.865566 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.865737 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.865894 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:29.866525 (+ 631us) server_negotiation.cc:299] Negotiation successful
0807 06:57:29.866678 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":852,"thread_start_us":482,"threads_started":1}
I20260807 06:57:29.867195 27962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.849840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:38591 (local address 127.0.0.1:57494)
0807 06:57:29.851496 (+ 1656us) negotiation.cc:107] Waiting for socket to connect
0807 06:57:29.851544 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:57:29.851791 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:57:29.859329 (+ 7538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:57:29.859336 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:57:29.859383 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:57:29.859943 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.859956 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.861823 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.861829 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.863946 (+ 2117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.863963 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.865688 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.865694 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.865902 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.865955 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 06:57:29.866140 (+ 185us) client_negotiation.cc:240] Negotiation successful
0807 06:57:29.866275 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1324,"mutex_wait_us":93,"thread_start_us":3491,"threads_started":1}
I20260807 06:57:29.867235 27963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.851376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47262 (local address 127.10.191.131:44099)
0807 06:57:29.857761 (+ 6385us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:29.857772 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:29.857816 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:57:29.857960 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:29.857970 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:29.858272 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:29.859595 (+ 1323us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:57:29.860175 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.861186 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.864174 (+ 2988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.865576 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.866576 (+ 1000us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.866713 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:29.866773 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 06:57:29.866916 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6152,"thread_start_us":5943,"threads_started":1}
I20260807 06:57:29.867439 27960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.850647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:44099 (local address 127.0.0.1:47262)
0807 06:57:29.853673 (+ 3026us) negotiation.cc:107] Waiting for socket to connect
0807 06:57:29.853708 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 06:57:29.853841 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:57:29.858869 (+ 5028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:57:29.858876 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:57:29.858906 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:57:29.859917 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.859934 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.861303 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.861309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.863978 (+ 2669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.863999 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.865799 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.865805 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.865974 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.866014 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 06:57:29.866093 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 06:57:29.866261 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2858,"mutex_wait_us":513,"thread_start_us":1045,"threads_started":1}
I20260807 06:57:29.867751 27966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.854550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:39951 (local address 127.0.0.1:46862)
0807 06:57:29.858044 (+ 3494us) negotiation.cc:107] Waiting for socket to connect
0807 06:57:29.858057 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:57:29.858197 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:57:29.859025 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:57:29.859029 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:57:29.859051 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:57:29.859595 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.859613 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.861568 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.861573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.864010 (+ 2437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.864018 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.866066 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.866074 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.866229 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.866254 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 06:57:29.866329 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 06:57:29.867086 (+ 757us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3385,"mutex_wait_us":79,"thread_start_us":3236,"threads_started":1}
I20260807 06:57:29.871199 27443 tablet_service.cc:1467] Processing CreateTablet for tablet 08ec931f53d842d5b6112d471d20ec09 (DEFAULT_TABLE table=test-table [id=f0d7cf4b45d5416c8d7c9d779996772c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:57:29.871330 27853 tablet_service.cc:1467] Processing CreateTablet for tablet 08ec931f53d842d5b6112d471d20ec09 (DEFAULT_TABLE table=test-table [id=f0d7cf4b45d5416c8d7c9d779996772c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:57:29.871330 27647 tablet_service.cc:1467] Processing CreateTablet for tablet 08ec931f53d842d5b6112d471d20ec09 (DEFAULT_TABLE table=test-table [id=f0d7cf4b45d5416c8d7c9d779996772c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:57:29.872666 27443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ec931f53d842d5b6112d471d20ec09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:57:29.872720 27647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ec931f53d842d5b6112d471d20ec09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:57:29.872720 27853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08ec931f53d842d5b6112d471d20ec09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:57:29.884481 27967 tablet_bootstrap.cc:492] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: Bootstrap starting.
I20260807 06:57:29.887359 27968 tablet_bootstrap.cc:492] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: Bootstrap starting.
I20260807 06:57:29.888090 27969 tablet_bootstrap.cc:492] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: Bootstrap starting.
I20260807 06:57:29.888113 27967 tablet_bootstrap.cc:654] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: Neither blocks nor log segments found. Creating new log.
I20260807 06:57:29.889462 27967 log.cc:824] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:57:29.891793 27968 tablet_bootstrap.cc:654] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: Neither blocks nor log segments found. Creating new log.
I20260807 06:57:29.891865 27969 tablet_bootstrap.cc:654] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: Neither blocks nor log segments found. Creating new log.
I20260807 06:57:29.892800 27968 log.cc:824] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: Log is configured to *not* fsync() on all Append() calls
I20260807 06:57:29.893520 27969 log.cc:824] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:57:29.895385 27968 tablet_bootstrap.cc:492] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: No bootstrap required, opened a new log
I20260807 06:57:29.895628 27968 ts_tablet_manager.cc:1397] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260807 06:57:29.899024 27967 tablet_bootstrap.cc:492] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: No bootstrap required, opened a new log
I20260807 06:57:29.899183 27969 tablet_bootstrap.cc:492] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: No bootstrap required, opened a new log
I20260807 06:57:29.899294 27967 ts_tablet_manager.cc:1397] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260807 06:57:29.899420 27969 ts_tablet_manager.cc:1397] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260807 06:57:29.902957 27968 raft_consensus.cc:348] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } }
I20260807 06:57:29.903322 27968 raft_consensus.cc:374] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:57:29.903412 27968 raft_consensus.cc:729] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d9ad078c5124082aab4075befec674f, State: Initialized, Role: FOLLOWER
I20260807 06:57:29.904021 27968 consensus_queue.cc:260] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } }
I20260807 06:57:29.905179 27939 heartbeater.cc:503] Master 127.10.191.190:38651 was elected leader, sending a full tablet report...
I20260807 06:57:29.905753 27968 ts_tablet_manager.cc:1428] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260807 06:57:29.909871 27967 raft_consensus.cc:348] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } }
I20260807 06:57:29.910285 27967 raft_consensus.cc:374] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:57:29.910379 27967 raft_consensus.cc:729] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cdb8c34dae54148b2a8f7a26e0e855e, State: Initialized, Role: FOLLOWER
I20260807 06:57:29.911007 27967 consensus_queue.cc:260] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } }
I20260807 06:57:29.911010 27969 raft_consensus.cc:348] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } }
I20260807 06:57:29.911446 27969 raft_consensus.cc:374] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:57:29.911573 27969 raft_consensus.cc:729] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf7e1804b724720b13807ca843c5ef5, State: Initialized, Role: FOLLOWER
I20260807 06:57:29.912199 27969 consensus_queue.cc:260] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } }
I20260807 06:57:29.913364 27745 heartbeater.cc:503] Master 127.10.191.190:38651 was elected leader, sending a full tablet report...
I20260807 06:57:29.914119 27967 ts_tablet_manager.cc:1428] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
I20260807 06:57:29.914124 27969 ts_tablet_manager.cc:1428] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
W20260807 06:57:29.919445 27535 tablet.cc:2369] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:57:29.922364 27979 raft_consensus.cc:482] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:57:29.922650 27979 raft_consensus.cc:504] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } }
I20260807 06:57:29.924190 27979 leader_election.cc:288] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cdb8c34dae54148b2a8f7a26e0e855e (127.10.191.129:38591), 4cf7e1804b724720b13807ca843c5ef5 (127.10.191.130:39951)
I20260807 06:57:29.929937 27947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.924379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:38591 (local address 127.10.191.131:54975)
0807 06:57:29.924549 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 06:57:29.924568 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:57:29.924706 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:57:29.924996 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:57:29.925000 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:57:29.925025 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:57:29.925444 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.925453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.926588 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.926591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.928271 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.928288 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.929454 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.929458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.929573 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.929596 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 06:57:29.929676 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 06:57:29.929758 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76,"mutex_wait_us":26}
I20260807 06:57:29.930090 27961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.924538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:54975 (local address 127.10.191.129:38591)
0807 06:57:29.924731 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:29.924738 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:29.924768 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:57:29.924836 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:29.924840 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:29.924891 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:29.924978 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:57:29.925605 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.926461 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.928434 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.929328 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.929472 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.929540 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:29.929725 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 06:57:29.929863 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 06:57:29.930964 27466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ec931f53d842d5b6112d471d20ec09" candidate_uuid: "7d9ad078c5124082aab4075befec674f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" is_pre_election: true
I20260807 06:57:29.931270 27965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.925007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:50725 (local address 127.10.191.130:39951)
0807 06:57:29.925256 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:29.925261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:29.925749 (+ 488us) server_negotiation.cc:407] Connection header received
0807 06:57:29.925849 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:29.925853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:29.925917 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:29.926003 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:57:29.926452 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.927137 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.929185 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.930253 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.930385 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.930459 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:29.930895 (+ 436us) server_negotiation.cc:299] Negotiation successful
0807 06:57:29.931025 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260807 06:57:29.931529 27466 raft_consensus.cc:2454] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d9ad078c5124082aab4075befec674f in term 0.
I20260807 06:57:29.932060 27983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.924797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:39951 (local address 127.10.191.131:50725)
0807 06:57:29.925654 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0807 06:57:29.925668 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:57:29.925765 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:57:29.926021 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:57:29.926023 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:57:29.926039 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:57:29.926321 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.926328 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.927293 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.927298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.928978 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:57:29.928990 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.930496 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.930502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:57:29.930703 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.930741 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 06:57:29.931471 (+ 730us) client_negotiation.cc:240] Negotiation successful
0807 06:57:29.931644 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"mutex_wait_us":1,"thread_start_us":552,"threads_started":1}
I20260807 06:57:29.932284 27775 leader_election.cc:302] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d9ad078c5124082aab4075befec674f, 9cdb8c34dae54148b2a8f7a26e0e855e; no voters:
I20260807 06:57:29.932611 27979 raft_consensus.cc:2781] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:57:29.932799 27979 raft_consensus.cc:482] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:57:29.932934 27979 raft_consensus.cc:3037] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:57:29.933575 27677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ec931f53d842d5b6112d471d20ec09" candidate_uuid: "7d9ad078c5124082aab4075befec674f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf7e1804b724720b13807ca843c5ef5" is_pre_election: true
I20260807 06:57:29.934125 27677 raft_consensus.cc:2454] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d9ad078c5124082aab4075befec674f in term 0.
I20260807 06:57:29.936124 27979 raft_consensus.cc:504] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } }
I20260807 06:57:29.936726 27979 leader_election.cc:288] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [CANDIDATE]: Term 1 election: Requested vote from peers 9cdb8c34dae54148b2a8f7a26e0e855e (127.10.191.129:38591), 4cf7e1804b724720b13807ca843c5ef5 (127.10.191.130:39951)
I20260807 06:57:29.937245 27466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ec931f53d842d5b6112d471d20ec09" candidate_uuid: "7d9ad078c5124082aab4075befec674f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e"
I20260807 06:57:29.937403 27677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08ec931f53d842d5b6112d471d20ec09" candidate_uuid: "7d9ad078c5124082aab4075befec674f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf7e1804b724720b13807ca843c5ef5"
I20260807 06:57:29.937464 27466 raft_consensus.cc:3037] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:57:29.937613 27677 raft_consensus.cc:3037] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:57:29.940831 27677 raft_consensus.cc:2454] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d9ad078c5124082aab4075befec674f in term 1.
I20260807 06:57:29.940831 27466 raft_consensus.cc:2454] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d9ad078c5124082aab4075befec674f in term 1.
I20260807 06:57:29.941275 27775 leader_election.cc:302] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf7e1804b724720b13807ca843c5ef5, 7d9ad078c5124082aab4075befec674f; no voters:
I20260807 06:57:29.941617 27979 raft_consensus.cc:2781] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:57:29.942116 27979 raft_consensus.cc:686] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 1 LEADER]: Becoming Leader. State: Replica: 7d9ad078c5124082aab4075befec674f, State: Running, Role: LEADER
I20260807 06:57:29.942736 27979 consensus_queue.cc:237] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } }
I20260807 06:57:29.947506 27238 catalog_manager.cc:5495] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d9ad078c5124082aab4075befec674f (127.10.191.131). New cstate: current_term: 1 leader_uuid: "7d9ad078c5124082aab4075befec674f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d9ad078c5124082aab4075befec674f" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 44099 } health_report { overall_health: HEALTHY } } }
W20260807 06:57:29.954058 27746 tablet.cc:2369] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:57:29.986457 27963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:29.981831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47268 (local address 127.10.191.131:44099)
0807 06:57:29.982026 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:29.982030 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:29.982049 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:57:29.982249 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:29.982254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:29.982332 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:29.982461 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:57:29.982789 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.983522 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.984627 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:29.984971 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:29.985052 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:29.985536 (+ 484us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:57:29.986014 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:57:29.986122 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:29.986205 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 06:57:29.986269 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:57:29.994809 27677 raft_consensus.cc:1261] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [term 1 FOLLOWER]: Refusing update from remote peer 7d9ad078c5124082aab4075befec674f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:57:29.994872 27466 raft_consensus.cc:1261] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [term 1 FOLLOWER]: Refusing update from remote peer 7d9ad078c5124082aab4075befec674f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:57:29.995880 27984 consensus_queue.cc:1035] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf7e1804b724720b13807ca843c5ef5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 39951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:57:29.996270 27979 consensus_queue.cc:1035] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cdb8c34dae54148b2a8f7a26e0e855e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 38591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:57:30.025823 27237 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:57:30.026129 27237 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:57:30.030045 27237 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8ae1a2f1dc24acda7880b7215cb506d: Sending DeleteTablet for 3 replicas of tablet 08ec931f53d842d5b6112d471d20ec09
I20260807 06:57:30.031437 27443 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ec931f53d842d5b6112d471d20ec09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:57:30 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:57494
I20260807 06:57:30.031497 27647 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ec931f53d842d5b6112d471d20ec09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:57:30 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:46862
I20260807 06:57:30.032179 27853 tablet_service.cc:1514] Processing DeleteTablet for tablet 08ec931f53d842d5b6112d471d20ec09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:57:30 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:47262
I20260807 06:57:30.033685 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 27351
I20260807 06:57:30.043177 28006 tablet_replica.cc:330] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: stopping tablet replica
I20260807 06:57:30.043948 28003 tablet_replica.cc:330] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: stopping tablet replica
I20260807 06:57:30.044267 28004 tablet_replica.cc:330] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: stopping tablet replica
I20260807 06:57:30.044518 28003 raft_consensus.cc:2229] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:57:30.044905 28004 raft_consensus.cc:2229] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:57:30.045089 28006 raft_consensus.cc:2229] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:57:30.045524 28004 raft_consensus.cc:2258] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:57:30.045693 28003 raft_consensus.cc:2258] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:57:30.046408 28006 raft_consensus.cc:2258] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:57:30.048115 28004 ts_tablet_manager.cc:1905] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:57:30.048943 28003 ts_tablet_manager.cc:1905] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:57:30.049739 28006 ts_tablet_manager.cc:1905] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 06:57:30 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:57:30.056318 28003 ts_tablet_manager.cc:1918] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:57:30.056440 28004 ts_tablet_manager.cc:1918] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:57:30.056631 28003 log.cc:1196] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/08ec931f53d842d5b6112d471d20ec09
I20260807 06:57:30.057497 28003 ts_tablet_manager.cc:1939] T 08ec931f53d842d5b6112d471d20ec09 P 9cdb8c34dae54148b2a8f7a26e0e855e: Deleting consensus metadata
I20260807 06:57:30.058933 28004 log.cc:1196] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/08ec931f53d842d5b6112d471d20ec09
I20260807 06:57:30.059527 28004 ts_tablet_manager.cc:1939] T 08ec931f53d842d5b6112d471d20ec09 P 4cf7e1804b724720b13807ca843c5ef5: Deleting consensus metadata
I20260807 06:57:30.059753 27220 catalog_manager.cc:4841] TS 9cdb8c34dae54148b2a8f7a26e0e855e (127.10.191.129:38591): tablet 08ec931f53d842d5b6112d471d20ec09 (table test-table [id=f0d7cf4b45d5416c8d7c9d779996772c]) successfully deleted
I20260807 06:57:30.061630 27220 catalog_manager.cc:4841] TS 4cf7e1804b724720b13807ca843c5ef5 (127.10.191.130:39951): tablet 08ec931f53d842d5b6112d471d20ec09 (table test-table [id=f0d7cf4b45d5416c8d7c9d779996772c]) successfully deleted
I20260807 06:57:30.064357 27961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:30.035436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57496 (local address 127.10.191.129:38591)
0807 06:57:30.035670 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:30.035679 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:30.043957 (+ 8278us) server_negotiation.cc:407] Connection header received
0807 06:57:30.044260 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:30.044265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:30.044354 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:30.044437 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:57:30.046502 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:30.047639 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:30.049609 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:30.050194 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:30.050288 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:30.056275 (+ 5987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:57:30.056290 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:57:30.056312 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:57:30.056352 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:57:30.060708 (+ 4356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:30.061627 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:30.061635 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:30.061638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:30.061827 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:30.062393 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:30.062413 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:30.062416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:30.062952 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:57:30.063272 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:30.063660 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 06:57:30.063948 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 06:57:30.064775 28006 ts_tablet_manager.cc:1918] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:57:30.065030 28006 log.cc:1196] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/08ec931f53d842d5b6112d471d20ec09
I20260807 06:57:30.065307 27527 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:57:30.065735 28006 ts_tablet_manager.cc:1939] T 08ec931f53d842d5b6112d471d20ec09 P 7d9ad078c5124082aab4075befec674f: Deleting consensus metadata
I20260807 06:57:30.068044 27222 catalog_manager.cc:4841] TS 7d9ad078c5124082aab4075befec674f (127.10.191.131:44099): tablet 08ec931f53d842d5b6112d471d20ec09 (table test-table [id=f0d7cf4b45d5416c8d7c9d779996772c]) successfully deleted
I20260807 06:57:30.154860 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 27351
I20260807 06:57:30.192049 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 27543
Aug 07 06:57:30 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:57:30.209460 27965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:30.192990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46864 (local address 127.10.191.130:39951)
0807 06:57:30.193251 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:30.193257 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:30.193280 (+ 23us) server_negotiation.cc:407] Connection header received
0807 06:57:30.193352 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:30.193357 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:30.193433 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:30.193556 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:57:30.194951 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:30.195689 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:30.197056 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:30.197597 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:30.197775 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:30.202408 (+ 4633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:57:30.202421 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:57:30.202435 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:57:30.202474 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:57:30.206004 (+ 3530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:30.206757 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:30.206765 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:30.206767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:30.206947 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:30.207452 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:30.207457 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:30.207460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:30.207983 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:57:30.208293 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:30.208661 (+ 368us) server_negotiation.cc:299] Negotiation successful
0807 06:57:30.208882 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260807 06:57:30.210223 27738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:57:30.300390 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 27543
I20260807 06:57:30.324987 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 27756
Aug 07 06:57:30 dist-test-slave-tfpf krb5kdc[26585](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:57:30.345000 27963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:57:30.325963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47270 (local address 127.10.191.131:44099)
0807 06:57:30.326159 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 06:57:30.326165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:57:30.326190 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:57:30.326405 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:57:30.326409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:57:30.326481 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:57:30.326570 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:57:30.328493 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:30.329503 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:30.331406 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:57:30.331817 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:57:30.331911 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:57:30.338110 (+ 6199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:57:30.338125 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:57:30.338142 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:57:30.338202 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:57:30.341546 (+ 3344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:30.342576 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:30.342583 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:30.342585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:30.342779 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:57:30.343354 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:57:30.343358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:57:30.343360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:57:30.343793 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:57:30.344035 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 06:57:30.344459 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 06:57:30.344686 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:57:30.345830 27933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:57:30.463198 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 27756
I20260807 06:57:30.490585 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 27198
I20260807 06:57:30.491830 27279 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:57:30.603539 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 27198
I20260807 06:57:30.638909 11006 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 06:57:30.985878 11006 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 06:57:30.986238 11006 mini_ranger.cc:66] Stopping Ranger...
I20260807 06:57:31.332590 11006 mini_ranger.cc:68] Stopped Ranger
2026-08-07 06:57:31.332 UTC [26628] LOG: received smart shutdown request
2026-08-07 06:57:31.336 UTC [26628] LOG: background worker "logical replication launcher" (PID 26640) exited with exit code 1
2026-08-07 06:57:31.336 UTC [26632] LOG: shutting down
2026-08-07 06:57:31.484 UTC [26628] LOG: database system is shut down
2026-08-07T06:57:31Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51117 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:57:31 dist-test-slave-tfpf krb5kdc[28027](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:57:31 dist-test-slave-tfpf krb5kdc[28027](info): set up 2 sockets
Aug 07 06:57:31 dist-test-slave-tfpf krb5kdc[28027](info): commencing operation
krb5kdc: starting...
W20260807 06:57:32.890980 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.001s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:57:33 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:57:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:57:33Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.191.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.191.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/rangeradmin_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/rangeradmin_127.10.191.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.191.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.191.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/rangerlookup_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/rangerlookup_127.10.191.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.191.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.191.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/HTTP_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/HTTP_127.10.191.148@KRBTEST.COM.keytab.
I20260807 06:57:33.300806 11006 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskHuszJs/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/postgres -l logfile start
2026-08-07 06:57:35.514 UTC [28067] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 06:57:35.514 UTC [28067] LOG: listening on IPv4 address "127.10.191.148", port 44687
2026-08-07 06:57:35.517 UTC [28067] LOG: listening on Unix socket "/tmp/.s.PGSQL.44687"
2026-08-07 06:57:35.537 UTC [28070] LOG: database system was shut down at 2026-08-07 06:57:34 UTC
2026-08-07 06:57:35.541 UTC [28067] LOG: database system is ready to accept connections
I20260807 06:57:36.687661 11006 mini_postgres.cc:96] Postgres bound to 44687
2026-08-07 06:57:36.713 UTC [28084] FATAL: database "slave" does not exist
127.10.191.148:44687 - accepting connections
I20260807 06:57:36.714579 11006 mini_ranger.cc:161] Starting Ranger...
I20260807 06:57:36.749867 11006 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 06:57:37.159442 11006 mini_ranger.cc:87] Created ranger Postgres database
I20260807 06:57:37.159543 11006 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-admin
2026-08-07 06:57:37,474 [I] DB FLAVOR :POSTGRES
2026-08-07 06:57:37,475 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:57:37,475 [I] Checking connection..
2026-08-07 06:57:37,475 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 06:57:37,738 [I] Checking connection passed.
2026-08-07 06:57:37,739 [I] --------- Verifying version history table ---------
2026-08-07 06:57:37,739 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:57:37,998 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:57:37,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:57:38,243 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 06:57:38,243 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 06:57:38,243 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 06:57:38.503 UTC [28186] WARNING: there is no transaction in progress
2026-08-07 06:57:38,511 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 06:57:38,511 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 06:57:38,771 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 06:57:38,772 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:57:38,772 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 06:57:39,040 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 06:57:39,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tfpf.c.gcp-upstream.internal','N') ;"
2026-08-07 06:57:39,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:57:39,801 [I] Table x_portal_user does not exist in database ranger
2026-08-07 06:57:39,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:57:40,060 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 06:57:40,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:57:40,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:57:40,582 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 06:57:40,582 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 06:57:41.490 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.504 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.519 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.531 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.546 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.561 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.611 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.617 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.630 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.639 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.648 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.661 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.669 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.674 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.679 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:41.685 UTC [28333] WARNING: there is no transaction in progress
2026-08-07 06:57:42,200 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 06:57:42,200 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 06:57:42,450 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 06:57:42,451 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 06:57:42,714 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 06:57:42,714 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 06:57:42,969 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 06:57:42,970 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 06:57:43,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 06:57:43,480 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tfpf.c.gcp-upstream.internal';"
2026-08-07 06:57:43,725 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 06:57:43,725 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 06:57:43,964 [I] DB_PATCHES have already been applied
I20260807 06:57:43.970283 11006 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-admin:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskHuszJs/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 06:57:43.970372 11006 mini_ranger.cc:193] Using host: 127.10.191.148
I20260807 06:57:43.992659 11006 mini_ranger.cc:227] Ranger admin URL: http://127.10.191.148:48851
Aug 07, 2026 6:57:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:57:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:57:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 6:57:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 6:57:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 6:57:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 6:57:44 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 06:57:45.324334 11006 mini_ranger.cc:160] Time spent starting Ranger: real 8.610s user 0.001s sys 0.067s
Aug 07, 2026 6:58:03 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 6:58:03 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 07, 2026 6:58:03 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 6:58:03 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 6:58:04 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 06:58:05.410792 11006 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.191.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.191.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/rangerkms_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.191.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/rangerkms_127.10.191.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.191.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.191.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.191.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/HTTP_127.10.191.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.191.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/HTTP_127.10.191.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 06:58:05 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085885, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 06:58:05.611779 11006 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 06:58:05.639570 11006 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 06:58:06.377921 11006 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 06:58:06.378072 11006 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-kms
I20260807 06:58:06.378126 11006 mini_ranger_kms.cc:227] Using postgres at 127.10.191.148:44687
2026-08-07 06:58:06,739 [I] DB FLAVOR :POSTGRES
2026-08-07 06:58:06,739 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 06:58:06,740 [I] Checking connection
2026-08-07 06:58:06,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 06:58:06,967 [I] connection success
2026-08-07 06:58:06,967 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 06:58:06,967 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 06:58:06,967 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 06:58:07,228 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 06:58:07,228 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 06:58:07,228 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 06:58:07,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.191.148:44687/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 06:58:07,507 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 06:58:07.991273 11006 mini_ranger_kms.cc:310] Created kms service
I20260807 06:58:08.151753 11006 mini_ranger_kms.cc:326] Created kudu user
I20260807 06:58:08.195283 11006 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 06:58:08 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085885, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:08.592821 11006 mini_ranger_kms.cc:384] Added ranger policy
I20260807 06:58:08.593305 11006 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-kms:/tmp/dist-test-taskHuszJs/build/asan/bin/postgresql.jar:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskHuszJs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 06:58:08.593379 11006 mini_ranger_kms.cc:240] Using host: 127.10.191.148
I20260807 06:58:08.616418 11006 mini_ranger_kms.cc:276] Ranger KMS PID: 28594
I20260807 06:58:08.616556 11006 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.191.148:35117
Aug 07, 2026 6:58:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 6:58:09 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 6:58:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 6:58:09 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 6:58:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 6:58:10 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 06:58:10 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085890, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.191.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:11.241426 11006 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.630s user 0.060s sys 0.340s
I20260807 06:58:11.241709 11006 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 06:58:11.241891 11006 mini_ranger_kms.cc:401] 127.10.191.148:35117/kms/v1/keys
Aug 07 06:58:11 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085890, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.191.148@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
Aug 07 06:58:11 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085890, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.191.148@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
Aug 07 06:58:13 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:58:14.003968 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:37317
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:37317
--ranger_config_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:35117/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:14.335260 28673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:14.335520 28673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:14.335632 28673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:14.342358 28673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:14.342448 28673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:14.342514 28673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:14.342571 28673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:14.342614 28673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:14.351974 28673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.191.148:35117/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:37317
--ranger_config_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:37317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:14.353124 28673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:14.354386 28673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:14.366073 28685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:14.365989 28688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:14.366050 28686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:14.366369 28673 server_base.cc:1034] running on GCE node
I20260807 06:58:14.367359 28673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:14.368572 28673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:14.369817 28673 hybrid_clock.cc:648] HybridClock initialized: now 1786085894369764 us; error 40 us; skew 500 ppm
I20260807 06:58:14.370168 28673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:14 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085894, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:14.373149 28673 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:58:14.374439 28673 webserver.cc:460] Webserver started at http://127.10.191.190:41673/ using document root <none> and password file <none>
I20260807 06:58:14.375077 28673 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:14.375218 28673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:14.375514 28673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:58:14 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085894, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:14.437546 28673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "d88aea16e4ba4005898097a3236ec1ed"
format_stamp: "Formatted at 2026-08-07 06:58:14 on dist-test-slave-tfpf"
server_key: "104a787b4488121d496cabe66f766017"
server_key_iv: "997556eb2c6580f4a004f8743b037e5f"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:14.438412 28673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "d88aea16e4ba4005898097a3236ec1ed"
format_stamp: "Formatted at 2026-08-07 06:58:14 on dist-test-slave-tfpf"
server_key: "104a787b4488121d496cabe66f766017"
server_key_iv: "997556eb2c6580f4a004f8743b037e5f"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:14.443914 28673 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 06:58:14.463948 28697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:14.465591 28673 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:58:14.465782 28673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "d88aea16e4ba4005898097a3236ec1ed"
format_stamp: "Formatted at 2026-08-07 06:58:14 on dist-test-slave-tfpf"
server_key: "104a787b4488121d496cabe66f766017"
server_key_iv: "997556eb2c6580f4a004f8743b037e5f"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:14.465992 28673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:14.479135 28673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:14.482960 28673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:14.483278 28673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:14.501344 28673 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:37317
I20260807 06:58:14.501367 28777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:37317 every 8 connection(s)
I20260807 06:58:14.502600 28673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:58:14.503228 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 28673
I20260807 06:58:14.503463 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:58:14.504316 11006 external_mini_cluster.cc:1428] Setting key 3a6052516ea23837634681cc455c4a3d
I20260807 06:58:14.507166 28778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 06:58:14 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:14.519829 28778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Bootstrap starting.
I20260807 06:58:14.522940 28778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:14.524253 28778 log.cc:824] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:14.527148 28778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: No bootstrap required, opened a new log
I20260807 06:58:14.527463 28782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:14.506246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.10.191.190:37317)
0807 06:58:14.507067 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:14.507083 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:14.507136 (+ 53us) server_negotiation.cc:407] Connection header received
0807 06:58:14.509470 (+ 2334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:14.509497 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:14.509937 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:14.510386 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:14.511521 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:14.513548 (+ 2027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:14.514750 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:14.515664 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:14.515853 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:14.520185 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:14.520193 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:14.520205 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:14.520239 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:14.523378 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:14.524180 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:14.524185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:14.524191 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:14.524363 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:14.524776 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:14.524781 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:14.524785 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:14.525349 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:14.525640 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:14.526124 (+ 484us) server_negotiation.cc:299] Negotiation successful
0807 06:58:14.526486 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":349,"threads_started":1}
I20260807 06:58:14.534659 28778 raft_consensus.cc:348] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } }
I20260807 06:58:14.534976 28778 raft_consensus.cc:374] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:14.535040 28778 raft_consensus.cc:729] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d88aea16e4ba4005898097a3236ec1ed, State: Initialized, Role: FOLLOWER
I20260807 06:58:14.535547 28778 consensus_queue.cc:260] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } }
I20260807 06:58:14.535808 28778 raft_consensus.cc:388] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:58:14.535945 28778 raft_consensus.cc:482] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:58:14.536204 28778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:14.538487 28778 raft_consensus.cc:504] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } }
I20260807 06:58:14.538924 28778 leader_election.cc:302] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d88aea16e4ba4005898097a3236ec1ed; no voters:
I20260807 06:58:14.539458 28778 leader_election.cc:288] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:58:14.539610 28784 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:58:14.540307 28784 raft_consensus.cc:686] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 1 LEADER]: Becoming Leader. State: Replica: d88aea16e4ba4005898097a3236ec1ed, State: Running, Role: LEADER
I20260807 06:58:14.540822 28784 consensus_queue.cc:237] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } }
I20260807 06:58:14.541631 28778 sys_catalog.cc:564] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:58:14.543697 28786 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d88aea16e4ba4005898097a3236ec1ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } } }
I20260807 06:58:14.543671 28787 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader d88aea16e4ba4005898097a3236ec1ed. Latest consensus state: current_term: 1 leader_uuid: "d88aea16e4ba4005898097a3236ec1ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } } }
I20260807 06:58:14.544099 28786 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:14.544099 28787 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:14.544910 28793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:58:14.550418 28793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:58:14.551024 28778 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 06:58:14.570006 28793 catalog_manager.cc:1347] Generated new cluster ID: e99f6b860e2248c7a7ef1435245eddaf
I20260807 06:58:14.570137 28793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:58:14.593603 28793 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:58:14.595504 28793 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:58:14.608023 28793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Generated new TSK 0
I20260807 06:58:14.609011 28793 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:58:15.396942 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:35117/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37317
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:58:15 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 06:58:15.815048 28845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:15.815356 28845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:15.815528 28845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:15.822719 28845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:15.822853 28845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:15.823021 28845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:58:15.834558 28845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.191.148:35117/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:15.835862 28845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:15.837294 28845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:15.855743 28860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:15.857425 28861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:15.865882 28864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:15.866683 28845 server_base.cc:1034] running on GCE node
I20260807 06:58:15.867636 28845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:15.869331 28845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:15.870684 28845 hybrid_clock.cc:648] HybridClock initialized: now 1786085895870614 us; error 54 us; skew 500 ppm
I20260807 06:58:15.871083 28845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:15 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:15.875494 28845 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:58:15.877581 28845 webserver.cc:460] Webserver started at http://127.10.191.129:34621/ using document root <none> and password file <none>
I20260807 06:58:15.878659 28845 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:15.878854 28845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:15.879311 28845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:58:15 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:15.900789 28845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "66d2429ee16445a1b7e051562dcf806e"
format_stamp: "Formatted at 2026-08-07 06:58:15 on dist-test-slave-tfpf"
server_key: "2bed292baae0eb3f14cdb38513e99cb2"
server_key_iv: "423b4b16eca041bf32fe49a8d251bf75"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:15.902112 28845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "66d2429ee16445a1b7e051562dcf806e"
format_stamp: "Formatted at 2026-08-07 06:58:15 on dist-test-slave-tfpf"
server_key: "2bed292baae0eb3f14cdb38513e99cb2"
server_key_iv: "423b4b16eca041bf32fe49a8d251bf75"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:15.915974 28845 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.004s sys 0.007s
I20260807 06:58:15.945329 28876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:15.947295 28845 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.009s sys 0.001s
I20260807 06:58:15.947599 28845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "66d2429ee16445a1b7e051562dcf806e"
format_stamp: "Formatted at 2026-08-07 06:58:15 on dist-test-slave-tfpf"
server_key: "2bed292baae0eb3f14cdb38513e99cb2"
server_key_iv: "423b4b16eca041bf32fe49a8d251bf75"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:15.947938 28845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:15.978037 28845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:15.982224 28845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:15.982523 28845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:15.983579 28845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:15.985217 28845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:15.985314 28845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:15.985441 28845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:15.985517 28845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:16.206727 28845 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:41905
I20260807 06:58:16.206743 29034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:41905 every 8 connection(s)
I20260807 06:58:16.208490 28845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:58:16.210820 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 28845
I20260807 06:58:16.211023 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:58:16.211759 11006 external_mini_cluster.cc:1428] Setting key 01c7030180cac1153ee799af39c3b698
Aug 07 06:58:16 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
Aug 07 06:58:16 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
I20260807 06:58:16.260311 29039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:16.218779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:45187 (local address 127.10.191.190:37317)
0807 06:58:16.228766 (+ 9987us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:16.228772 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:16.228791 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:58:16.228850 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:16.228854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:16.228941 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:16.229208 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:16.234158 (+ 4950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:16.235236 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:16.238987 (+ 3751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:16.239772 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:16.239919 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:16.244374 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:16.244383 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:16.244391 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:16.244448 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:16.249688 (+ 5240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:16.250664 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:16.250672 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:16.250678 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:16.250857 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:16.252257 (+ 1400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:16.252264 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:16.252270 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:16.252675 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:16.252826 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:16.259726 (+ 6900us) server_negotiation.cc:299] Negotiation successful
0807 06:58:16.259944 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9844,"thread_start_us":12274,"threads_started":1}
I20260807 06:58:16.261699 29037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:16.218145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37317 (local address 127.10.191.129:45187)
0807 06:58:16.225660 (+ 7515us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:16.225718 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:16.228050 (+ 2332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:16.232434 (+ 4384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:16.232446 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:16.233112 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:16.233938 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:16.233965 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:16.235422 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:16.235427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:16.237502 (+ 2075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:16.237539 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:16.240066 (+ 2527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:16.240075 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:16.240431 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:16.241216 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:16.241247 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:16.244079 (+ 2832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:16.249855 (+ 5776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:16.249867 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:16.249888 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:16.250515 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:16.251024 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:16.251032 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:16.251038 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:16.251308 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:16.252910 (+ 1602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:16.252921 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:16.253760 (+ 839us) client_negotiation.cc:769] Sending connection context
0807 06:58:16.254631 (+ 871us) client_negotiation.cc:240] Negotiation successful
0807 06:58:16.255310 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7185,"thread_start_us":12884,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
I20260807 06:58:16.267509 29036 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37317
I20260807 06:58:16.267846 29036 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:16.268735 29036 heartbeater.cc:511] Master 127.10.191.190:37317 requested a full tablet report, sending...
I20260807 06:58:16.271374 28722 ts_manager.cc:194] Registered new tserver with Master: 66d2429ee16445a1b7e051562dcf806e (127.10.191.129:41905)
I20260807 06:58:16.273428 28722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:45187
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:58:16.308109 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:35117/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37317
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:58:16 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085895, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
W20260807 06:58:16.741148 29044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:16.741653 29044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:16.741868 29044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:16.751530 29044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:16.751693 29044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:16.751892 29044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:58:16.765918 29044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.191.148:35117/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:16.768030 29044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:16.769608 29044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:16.795751 29053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:16.799621 29057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:16.802976 29060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:16.804054 29044 server_base.cc:1034] running on GCE node
I20260807 06:58:16.804867 29044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:16.812358 29044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:16.813959 29044 hybrid_clock.cc:648] HybridClock initialized: now 1786085896813833 us; error 124 us; skew 500 ppm
I20260807 06:58:16.814422 29044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:16 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085896, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:16.818970 29044 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:58:16.827009 29044 webserver.cc:460] Webserver started at http://127.10.191.130:43605/ using document root <none> and password file <none>
I20260807 06:58:16.827999 29044 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:16.828141 29044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:16.828522 29044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:58:16 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085896, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:16.851933 29044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "fe8dfa9ac8964ba297506c54919b1df0"
format_stamp: "Formatted at 2026-08-07 06:58:16 on dist-test-slave-tfpf"
server_key: "022f457f5a6ac0680cad258fe2ec90c2"
server_key_iv: "6891a1f46ce6d7ebf06deef9cc3b41d0"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:16.853053 29044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "fe8dfa9ac8964ba297506c54919b1df0"
format_stamp: "Formatted at 2026-08-07 06:58:16 on dist-test-slave-tfpf"
server_key: "022f457f5a6ac0680cad258fe2ec90c2"
server_key_iv: "6891a1f46ce6d7ebf06deef9cc3b41d0"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:16.873392 29044 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.003s sys 0.006s
I20260807 06:58:16.901641 29083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:16.903437 29044 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 06:58:16.903630 29044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "fe8dfa9ac8964ba297506c54919b1df0"
format_stamp: "Formatted at 2026-08-07 06:58:16 on dist-test-slave-tfpf"
server_key: "022f457f5a6ac0680cad258fe2ec90c2"
server_key_iv: "6891a1f46ce6d7ebf06deef9cc3b41d0"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:16.903890 29044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:16.949548 29044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:16.953742 29044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:16.954094 29044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:16.955148 29044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:16.956707 29044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:16.956815 29044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:16.956964 29044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:16.957038 29044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:17.001339 29044 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:42201
I20260807 06:58:17.001426 29239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:42201 every 8 connection(s)
I20260807 06:58:17.002664 29044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:58:17.007688 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 29044
I20260807 06:58:17.007890 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:58:17.008363 11006 external_mini_cluster.cc:1428] Setting key 28056f557040ea4226870fa5c8c6bae8
Aug 07 06:58:17 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085896, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:17.027457 29242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:17.005484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:60979 (local address 127.10.191.190:37317)
0807 06:58:17.006033 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:17.006039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:17.007157 (+ 1118us) server_negotiation.cc:407] Connection header received
0807 06:58:17.009749 (+ 2592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:17.009754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:17.009817 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:17.009915 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:17.011771 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.013015 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.015330 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.016059 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.016205 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:17.020716 (+ 4511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:17.020723 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:17.020730 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:17.020774 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:17.024197 (+ 3423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.024990 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.024993 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.024996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.025174 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.025584 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.025590 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.025593 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.025885 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:17.026064 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:17.026759 (+ 695us) server_negotiation.cc:299] Negotiation successful
0807 06:58:17.027005 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":404,"thread_start_us":269,"threads_started":1}
I20260807 06:58:17.028357 29243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:17.006056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37317 (local address 127.10.191.130:60979)
0807 06:58:17.006958 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:17.007021 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:17.009435 (+ 2414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:17.010193 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:17.010205 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:17.010808 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:17.011573 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:17.011598 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.013192 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.013198 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:17.015153 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:17.015180 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.016329 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.016336 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:17.016658 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:17.017519 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:17.017549 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:17.020471 (+ 2922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:17.024330 (+ 3859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:17.024339 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:17.024355 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:17.024844 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:17.025281 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:17.025286 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:17.025290 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:17.025472 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:17.026051 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:17.026058 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:17.026389 (+ 331us) client_negotiation.cc:769] Sending connection context
0807 06:58:17.026668 (+ 279us) client_negotiation.cc:240] Negotiation successful
0807 06:58:17.027208 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":380,"threads_started":1}
I20260807 06:58:17.029985 29240 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37317
I20260807 06:58:17.030325 29240 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:17.031167 29240 heartbeater.cc:511] Master 127.10.191.190:37317 requested a full tablet report, sending...
I20260807 06:58:17.032732 28722 ts_manager.cc:194] Registered new tserver with Master: fe8dfa9ac8964ba297506c54919b1df0 (127.10.191.130:42201)
I20260807 06:58:17.033588 28722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:60979
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:58:17.088125 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:35117/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37317
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:58:17.277168 29036 heartbeater.cc:503] Master 127.10.191.190:37317 was elected leader, sending a full tablet report...
W20260807 06:58:17.420975 29248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:17.421315 29248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:17.421412 29248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:17.428324 29248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:17.428419 29248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:17.428526 29248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:58:17.441160 29248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.191.148:35117/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:37317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:17.442492 29248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:17.443804 29248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:17.457454 29255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:17.457501 29258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:17.457547 29256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:17.458324 29248 server_base.cc:1034] running on GCE node
I20260807 06:58:17.458890 29248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:17.459820 29248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:17.461048 29248 hybrid_clock.cc:648] HybridClock initialized: now 1786085897460988 us; error 49 us; skew 500 ppm
I20260807 06:58:17.461385 29248 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:17 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085897, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:17.464435 29248 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:58:17.465881 29248 webserver.cc:460] Webserver started at http://127.10.191.131:37815/ using document root <none> and password file <none>
I20260807 06:58:17.466657 29248 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:17.466811 29248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:17.467142 29248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 06:58:17 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085897, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:17.483211 29248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "df00b65eba124bae944ef94aeaa8e84a"
format_stamp: "Formatted at 2026-08-07 06:58:17 on dist-test-slave-tfpf"
server_key: "86bc6267b70146d7dac41b4dd2d06f1a"
server_key_iv: "f4c2f9e35406b5a7a9fe3bd95d878fdd"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:17.484223 29248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "df00b65eba124bae944ef94aeaa8e84a"
format_stamp: "Formatted at 2026-08-07 06:58:17 on dist-test-slave-tfpf"
server_key: "86bc6267b70146d7dac41b4dd2d06f1a"
server_key_iv: "f4c2f9e35406b5a7a9fe3bd95d878fdd"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:17.490952 29248 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260807 06:58:17.508124 29265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:17.509836 29248 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:58:17.510002 29248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "df00b65eba124bae944ef94aeaa8e84a"
format_stamp: "Formatted at 2026-08-07 06:58:17 on dist-test-slave-tfpf"
server_key: "86bc6267b70146d7dac41b4dd2d06f1a"
server_key_iv: "f4c2f9e35406b5a7a9fe3bd95d878fdd"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:17.510227 29248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:17.546106 29248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:17.550382 29248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:17.550724 29248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:17.551683 29248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:17.553190 29248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:17.553295 29248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:17.553467 29248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:17.553539 29248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:17.592136 29248 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:37667
I20260807 06:58:17.592175 29424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:37667 every 8 connection(s)
I20260807 06:58:17.593554 29248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:58:17.598562 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 29248
I20260807 06:58:17.598774 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:58:17.599225 11006 external_mini_cluster.cc:1428] Setting key ac96484d9d2b6cfdf0ee3167f8fa4530
Aug 07 06:58:17 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085897, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:17.617786 29433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:17.596507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:47525 (local address 127.10.191.190:37317)
0807 06:58:17.597127 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:17.597134 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:17.598199 (+ 1065us) server_negotiation.cc:407] Connection header received
0807 06:58:17.601178 (+ 2979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:17.601185 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:17.601297 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:17.601413 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:17.603980 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.604637 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.606759 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.607214 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.607308 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:17.611067 (+ 3759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:17.611072 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:17.611075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:17.611106 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:17.614197 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.615384 (+ 1187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.615402 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.615407 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.615543 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.615999 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.616002 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.616004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.616256 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:17.616448 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:17.617178 (+ 730us) server_negotiation.cc:299] Negotiation successful
0807 06:58:17.617405 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":289,"threads_started":1}
I20260807 06:58:17.618706 29435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:17.597107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37317 (local address 127.10.191.131:47525)
0807 06:58:17.597988 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:17.598043 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:17.600817 (+ 2774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:17.602465 (+ 1648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:17.602475 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:17.603055 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:17.603815 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:17.603838 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.604804 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.604809 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:17.606624 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:17.606639 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.607447 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.607455 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:17.607730 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:17.608413 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:17.608446 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:17.610837 (+ 2391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:17.614723 (+ 3886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:17.614731 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:17.614745 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:17.615263 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:17.615655 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:17.615660 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:17.615663 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:17.615872 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:17.616421 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:17.616429 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:17.616768 (+ 339us) client_negotiation.cc:769] Sending connection context
0807 06:58:17.617028 (+ 260us) client_negotiation.cc:240] Negotiation successful
0807 06:58:17.617516 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":371,"threads_started":1}
I20260807 06:58:17.620151 29429 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37317
I20260807 06:58:17.620456 29429 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:17.621250 29429 heartbeater.cc:511] Master 127.10.191.190:37317 requested a full tablet report, sending...
I20260807 06:58:17.622782 28722 ts_manager.cc:194] Registered new tserver with Master: df00b65eba124bae944ef94aeaa8e84a (127.10.191.131:37667)
I20260807 06:58:17.623874 28722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:47525
I20260807 06:58:17.627331 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:58:17.629778 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 28845
Aug 07 06:58:17 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:58:17.648154 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:17.630834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55714 (local address 127.10.191.129:41905)
0807 06:58:17.631698 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:17.631704 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:17.631725 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:58:17.631775 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:17.631780 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:17.631934 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:17.632096 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:17.633567 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.634448 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.636034 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.636612 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.636778 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:17.640945 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:17.640957 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:17.640972 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:17.641037 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:17.644575 (+ 3538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.645256 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.645264 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.645266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.645466 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.645928 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.645935 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.645941 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.646451 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:17.646768 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:17.647462 (+ 694us) server_negotiation.cc:299] Negotiation successful
0807 06:58:17.647740 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":578,"threads_started":1}
I20260807 06:58:17.650121 29027 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:17.753998 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 28845
I20260807 06:58:17.783119 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 29044
Aug 07 06:58:17 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:58:17.800845 29441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:17.784293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59232 (local address 127.10.191.130:42201)
0807 06:58:17.784806 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:17.784813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:17.784837 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:58:17.784897 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:17.784903 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:17.785181 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:17.785344 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:17.786706 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.787716 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.789234 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.789785 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.789926 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:17.794356 (+ 4430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:17.794369 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:17.794386 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:17.794424 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:17.797942 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.798582 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.798592 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.798596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.798776 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.799167 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.799172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.799175 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.799591 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:17.799889 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:17.800165 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 06:58:17.800429 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":250,"threads_started":1}
I20260807 06:58:17.802246 29235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:17.882941 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 29044
I20260807 06:58:17.913759 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 29248
Aug 07 06:58:17 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:58:17.929503 29443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:17.914767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46348 (local address 127.10.191.131:37667)
0807 06:58:17.915468 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:17.915483 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:17.915513 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:58:17.915575 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:17.915581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:17.915799 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:17.915927 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:17.917286 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.918274 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.919524 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:17.920067 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:17.920162 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:17.924390 (+ 4228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:17.924402 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:17.924416 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:17.924459 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:17.927147 (+ 2688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.927761 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.927768 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.927770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.927891 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:17.928209 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:17.928211 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:17.928213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:17.928510 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:17.928747 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:17.928921 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 06:58:17.929238 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":389,"threads_started":1}
I20260807 06:58:17.930776 29420 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:18.009158 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 29248
I20260807 06:58:18.037060 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 28673
I20260807 06:58:18.038380 28769 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:18.138825 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 28673
I20260807 06:58:18.172479 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:37317
--webserver_interface=127.10.191.190
--webserver_port=41673
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:37317
--ranger_config_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:35117/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.191.148:35117/kms with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:18.490561 29447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:18.490875 29447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:18.491057 29447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:18.497876 29447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:18.498035 29447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:18.498134 29447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:18.498241 29447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:18.498349 29447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:18.507501 29447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.191.148:35117/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:37317
--ranger_config_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:37317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=41673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:18.508724 29447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:18.510025 29447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:18.522029 29455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:18.522244 29459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:18.522207 29456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:18.522747 29447 server_base.cc:1034] running on GCE node
I20260807 06:58:18.523576 29447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:18.524971 29447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:18.526222 29447 hybrid_clock.cc:648] HybridClock initialized: now 1786085898526178 us; error 71 us; skew 500 ppm
I20260807 06:58:18.526575 29447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:18 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085898, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:18.529783 29447 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:58:18.531176 29447 webserver.cc:460] Webserver started at http://127.10.191.190:41673/ using document root <none> and password file <none>
I20260807 06:58:18.531822 29447 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:18.531970 29447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:58:18 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085898, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:18.583942 29447 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:58:18.587580 29467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:18.588989 29447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:18.589237 29447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "d88aea16e4ba4005898097a3236ec1ed"
format_stamp: "Formatted at 2026-08-07 06:58:14 on dist-test-slave-tfpf"
server_key: "104a787b4488121d496cabe66f766017"
server_key_iv: "997556eb2c6580f4a004f8743b037e5f"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:18.590199 29447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:18.617293 29447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:18.621704 29447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:18.621951 29447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:18.639246 29447 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:37317
I20260807 06:58:18.639312 29530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:37317 every 8 connection(s)
I20260807 06:58:18.640671 29447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:58:18.647706 29531 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:58:18.649199 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 29447
I20260807 06:58:18.650269 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:35117/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:41905
--local_ip_for_outbound_sockets=127.10.191.129
--tserver_master_addrs=127.10.191.190:37317
--webserver_port=34621
--webserver_interface=127.10.191.129
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.191.148:35117/kms with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:58:18.652227 29531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Bootstrap starting.
I20260807 06:58:18.672678 29531 log.cc:824] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:18.681219 29531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:58:18.681737 29531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Bootstrap complete.
I20260807 06:58:18.690682 29531 raft_consensus.cc:348] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } }
I20260807 06:58:18.691473 29531 raft_consensus.cc:729] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d88aea16e4ba4005898097a3236ec1ed, State: Initialized, Role: FOLLOWER
I20260807 06:58:18.692114 29531 consensus_queue.cc:260] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } }
I20260807 06:58:18.692340 29531 raft_consensus.cc:388] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:58:18.692468 29531 raft_consensus.cc:482] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:58:18.692662 29531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:58:18.696585 29531 raft_consensus.cc:504] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } }
I20260807 06:58:18.697165 29531 leader_election.cc:302] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d88aea16e4ba4005898097a3236ec1ed; no voters:
I20260807 06:58:18.697872 29531 leader_election.cc:288] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:58:18.698007 29535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:58:18.700183 29531 sys_catalog.cc:564] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:58:18.703266 29535 raft_consensus.cc:686] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [term 2 LEADER]: Becoming Leader. State: Replica: d88aea16e4ba4005898097a3236ec1ed, State: Running, Role: LEADER
I20260807 06:58:18.704090 29535 consensus_queue.cc:237] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } }
I20260807 06:58:18.707329 29537 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d88aea16e4ba4005898097a3236ec1ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } } }
I20260807 06:58:18.707808 29537 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:18.708297 29539 sys_catalog.cc:455] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader d88aea16e4ba4005898097a3236ec1ed. Latest consensus state: current_term: 2 leader_uuid: "d88aea16e4ba4005898097a3236ec1ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d88aea16e4ba4005898097a3236ec1ed" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 37317 } } }
I20260807 06:58:18.708592 29539 sys_catalog.cc:458] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:18.712009 29553 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:58:18.717797 29553 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:58:18.718622 29531 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 06:58:18.719340 29553 catalog_manager.cc:1259] Loaded cluster ID: e99f6b860e2248c7a7ef1435245eddaf
I20260807 06:58:18.719502 29553 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:58:18.724575 29553 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:58:18.726548 29553 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Loaded TSK: 0
I20260807 06:58:18.728489 29553 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:58:19.104803 29533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:19.105230 29533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:19.105455 29533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:19.116942 29533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:19.117163 29533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:19.117385 29533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:58:19.133224 29533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.191.148:35117/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:41905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=34621
--tserver_master_addrs=127.10.191.190:37317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:19.135245 29533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:19.137238 29533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:19.175976 29587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:19.176389 29586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:19.182543 29590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:19.184345 29533 server_base.cc:1034] running on GCE node
I20260807 06:58:19.185222 29533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:19.186630 29533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:19.187963 29533 hybrid_clock.cc:648] HybridClock initialized: now 1786085899187843 us; error 105 us; skew 500 ppm
I20260807 06:58:19.188370 29533 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:19 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:19.200297 29533 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:58:19.231312 29533 webserver.cc:460] Webserver started at http://127.10.191.129:34621/ using document root <none> and password file <none>
I20260807 06:58:19.232475 29533 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:19.232703 29533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:58:19 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:19.285722 29533 fs_manager.cc:709] Time spent opening directory manager: real 0.023s user 0.010s sys 0.005s
I20260807 06:58:19.294831 29602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:19.296867 29533 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.004s sys 0.003s
I20260807 06:58:19.297166 29533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "66d2429ee16445a1b7e051562dcf806e"
format_stamp: "Formatted at 2026-08-07 06:58:15 on dist-test-slave-tfpf"
server_key: "2bed292baae0eb3f14cdb38513e99cb2"
server_key_iv: "423b4b16eca041bf32fe49a8d251bf75"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:19.298668 29533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:19.350488 29533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:19.355710 29533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:19.356103 29533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:19.357427 29533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:19.360989 29533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:19.361155 29533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:19.361294 29533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:19.361373 29533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:19.415815 29533 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:41905
I20260807 06:58:19.415899 29791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:41905 every 8 connection(s)
I20260807 06:58:19.417930 29533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:58:19.418706 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 29533
I20260807 06:58:19.419517 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:35117/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:42201
--local_ip_for_outbound_sockets=127.10.191.130
--tserver_master_addrs=127.10.191.190:37317
--webserver_port=43605
--webserver_interface=127.10.191.130
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.191.148:35117/kms with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:58:19 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:19.476318 29797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:19.423612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37317 (local address 127.10.191.129:60389)
0807 06:58:19.437763 (+ 14151us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:19.437819 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:19.440414 (+ 2595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:19.445001 (+ 4587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:19.445012 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:19.448742 (+ 3730us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:19.449768 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:19.449795 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:19.456749 (+ 6954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:19.456755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:19.458823 (+ 2068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:19.458838 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:19.460651 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:19.460660 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:19.460933 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:19.461780 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:19.461810 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:19.464900 (+ 3090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:19.471199 (+ 6299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:19.471207 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:19.471220 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:19.471765 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:19.472339 (+ 574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:19.472344 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:19.472347 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:19.472618 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:19.474030 (+ 1412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:19.474037 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:19.474412 (+ 375us) client_negotiation.cc:769] Sending connection context
0807 06:58:19.474687 (+ 275us) client_negotiation.cc:240] Negotiation successful
0807 06:58:19.475173 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13837,"thread_start_us":13642,"threads_started":1}
I20260807 06:58:19.478708 29794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:19.423450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:60389 (local address 127.10.191.190:37317)
0807 06:58:19.435985 (+ 12535us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:19.436005 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:19.438472 (+ 2467us) server_negotiation.cc:407] Connection header received
0807 06:58:19.441330 (+ 2858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:19.441349 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:19.443107 (+ 1758us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:19.443534 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:19.450492 (+ 6958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:19.453497 (+ 3005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:19.459021 (+ 5524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:19.460053 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:19.460254 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:19.465249 (+ 4995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:19.465259 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:19.465278 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:19.465327 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:19.471016 (+ 5689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:19.471937 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:19.471945 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:19.471953 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:19.472168 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:19.473197 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:19.473201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:19.473204 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:19.473760 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:19.473936 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:19.477092 (+ 3156us) server_negotiation.cc:299] Negotiation successful
0807 06:58:19.477484 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12237,"thread_start_us":12024,"threads_started":1}
I20260807 06:58:19.483045 29792 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37317
I20260807 06:58:19.483383 29792 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:19.484277 29792 heartbeater.cc:511] Master 127.10.191.190:37317 requested a full tablet report, sending...
W20260807 06:58:19.487632 29792 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:37317 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 06:58:19.487907 29792 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:19.488183 29792 heartbeater.cc:511] Master 127.10.191.190:37317 requested a full tablet report, sending...
I20260807 06:58:19.489436 29792 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:19.489758 29792 heartbeater.cc:511] Master 127.10.191.190:37317 requested a full tablet report, sending...
W20260807 06:58:19.490865 29792 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:58:19.827348 29798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:19.827823 29798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:19.828023 29798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:19.838629 29798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:19.838799 29798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:19.839015 29798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:58:19.854158 29798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.191.148:35117/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:42201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=43605
--tserver_master_addrs=127.10.191.190:37317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:19.855720 29798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:19.857456 29798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:19.874183 29820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:19.874316 29819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:19.879693 29798 server_base.cc:1034] running on GCE node
W20260807 06:58:19.880371 29824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:19.881124 29798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:19.882143 29798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:19.883395 29798 hybrid_clock.cc:648] HybridClock initialized: now 1786085899883338 us; error 50 us; skew 500 ppm
I20260807 06:58:19.883780 29798 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:19 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:19.887724 29798 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:58:19.889669 29798 webserver.cc:460] Webserver started at http://127.10.191.130:43605/ using document root <none> and password file <none>
I20260807 06:58:19.890507 29798 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:19.890651 29798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:58:19 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786085899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 06:58:19 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:19.924566 29798 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.000s
I20260807 06:58:19.933609 29832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:19.935236 29798 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.001s sys 0.007s
I20260807 06:58:19.935413 29798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "fe8dfa9ac8964ba297506c54919b1df0"
format_stamp: "Formatted at 2026-08-07 06:58:16 on dist-test-slave-tfpf"
server_key: "022f457f5a6ac0680cad258fe2ec90c2"
server_key_iv: "6891a1f46ce6d7ebf06deef9cc3b41d0"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:19.936781 29798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:19.963501 29798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:19.968580 29798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:19.968871 29798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:19.970127 29798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:19.971880 29798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:19.972000 29798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:19.972110 29798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:19.972198 29798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:20.040551 29798 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:42201
I20260807 06:58:20.040602 29996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:42201 every 8 connection(s)
I20260807 06:58:20.042402 29798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:58:20.052300 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 29798
I20260807 06:58:20.053320 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.191.148:35117/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:37667
--local_ip_for_outbound_sockets=127.10.191.131
--tserver_master_addrs=127.10.191.190:37317
--webserver_port=37815
--webserver_interface=127.10.191.131
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.191.148:35117/kms with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:58:20 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:20.098464 30000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:20.046298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37317 (local address 127.10.191.130:48141)
0807 06:58:20.070176 (+ 23878us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:20.070245 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:20.076701 (+ 6456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:20.078331 (+ 1630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:20.078343 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:20.078987 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:20.079812 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:20.079839 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:20.081413 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:20.081419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:20.083476 (+ 2057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:20.083502 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:20.084658 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:20.084666 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:20.084954 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:20.085921 (+ 967us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:20.085954 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:20.088811 (+ 2857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:20.093285 (+ 4474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:20.093294 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:20.093309 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:20.094005 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:20.094488 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:20.094493 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:20.094497 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:20.094852 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:20.095579 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:20.095586 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:20.096000 (+ 414us) client_negotiation.cc:769] Sending connection context
0807 06:58:20.096362 (+ 362us) client_negotiation.cc:240] Negotiation successful
0807 06:58:20.096948 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23562,"thread_start_us":26712,"threads_started":1}
I20260807 06:58:20.099462 29999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:20.045453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:48141 (local address 127.10.191.190:37317)
0807 06:58:20.077522 (+ 32069us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:20.077527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:20.077544 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:58:20.077598 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:20.077601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:20.077694 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:20.077820 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:20.080039 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:20.081186 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:20.083663 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:20.084237 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:20.084356 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:20.089073 (+ 4717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:20.089098 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:20.089105 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:20.089147 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:20.093117 (+ 3970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:20.094198 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:20.094203 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:20.094206 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:20.094345 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:20.094993 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:20.094998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:20.095001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:20.095352 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:20.095494 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:20.098824 (+ 3330us) server_negotiation.cc:299] Negotiation successful
0807 06:58:20.099070 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31932,"thread_start_us":31830,"threads_started":1}
I20260807 06:58:20.101475 29997 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37317
I20260807 06:58:20.101799 29997 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:20.102682 29997 heartbeater.cc:511] Master 127.10.191.190:37317 requested a full tablet report, sending...
I20260807 06:58:20.104802 29486 ts_manager.cc:194] Registered new tserver with Master: fe8dfa9ac8964ba297506c54919b1df0 (127.10.191.130:42201)
I20260807 06:58:20.107024 29486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:48141
Aug 07 06:58:20 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:20.491030 29792 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:20.491533 29792 heartbeater.cc:511] Master 127.10.191.190:37317 requested a full tablet report, sending...
I20260807 06:58:20.492942 29486 ts_manager.cc:194] Registered new tserver with Master: 66d2429ee16445a1b7e051562dcf806e (127.10.191.129:41905)
I20260807 06:58:20.494115 29486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:60389
W20260807 06:58:20.538044 30001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:20.538494 30001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:20.538667 30001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:20.549014 30001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:20.549234 30001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:20.549458 30001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:58:20.563651 30001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.191.148:35117/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:37667
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=37815
--tserver_master_addrs=127.10.191.190:37317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:20.565433 30001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:20.567157 30001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:20.602034 30009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:20.604032 30007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:20.610656 30001 server_base.cc:1034] running on GCE node
W20260807 06:58:20.613372 30015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:20.616519 30001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:20.628196 30001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:20.631946 30001 hybrid_clock.cc:648] HybridClock initialized: now 1786085900631828 us; error 86 us; skew 500 ppm
I20260807 06:58:20.632560 30001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:20 dist-test-slave-tfpf krb5kdc[28027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085900, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:20.637897 30001 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
Aug 07 06:58:20 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085899, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:20.680959 30001 webserver.cc:460] Webserver started at http://127.10.191.131:37815/ using document root <none> and password file <none>
I20260807 06:58:20.682036 30001 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:20.682221 30001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 06:58:20 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085900, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for HTTP/127.10.191.148@KRBTEST.COM
I20260807 06:58:20.748440 30001 fs_manager.cc:709] Time spent opening directory manager: real 0.026s user 0.012s sys 0.012s
I20260807 06:58:20.758692 30026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:20.760665 30001 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.003s sys 0.006s
I20260807 06:58:20.760874 30001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "df00b65eba124bae944ef94aeaa8e84a"
format_stamp: "Formatted at 2026-08-07 06:58:17 on dist-test-slave-tfpf"
server_key: "86bc6267b70146d7dac41b4dd2d06f1a"
server_key_iv: "f4c2f9e35406b5a7a9fe3bd95d878fdd"
server_key_version: "kuduclusterkey@0"
I20260807 06:58:20.762315 30001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:20.799803 30001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:20.805378 30001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:20.805666 30001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:20.813128 30001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:20.820914 30001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:20.821031 30001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:20.821195 30001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:20.821282 30001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:20.993877 30001 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:37667
I20260807 06:58:20.993922 30194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:37667 every 8 connection(s)
I20260807 06:58:20.995824 30001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:58:21.003060 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 30001
Aug 07 06:58:21 dist-test-slave-tfpf krb5kdc[28027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085900, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:21.020365 30197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:20.998593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:57207 (local address 127.10.191.190:37317)
0807 06:58:20.999152 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:20.999159 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.000049 (+ 890us) server_negotiation.cc:407] Connection header received
0807 06:58:21.002439 (+ 2390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.002443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.002515 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.002612 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:21.004517 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.005622 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.007953 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.008560 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.008649 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.012945 (+ 4296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:21.012951 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:21.012955 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:21.012993 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:21.016533 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.017518 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.017524 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.017528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.017714 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.018263 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.018268 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.018271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.018626 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:21.018757 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.019735 (+ 978us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.019951 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":278,"threads_started":1}
I20260807 06:58:21.022241 30198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:20.999063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:37317 (local address 127.10.191.131:57207)
0807 06:58:20.999870 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:20.999924 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:21.002154 (+ 2230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:21.002856 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:21.002867 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:21.003543 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:21.004297 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.004336 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.005845 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.005850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.007772 (+ 1922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.007795 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.009020 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.009026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.009298 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.010077 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:21.010116 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:21.012706 (+ 2590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:21.016738 (+ 4032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:21.016747 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:21.016762 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:21.017361 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:21.017895 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:21.017899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:21.017903 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:21.018135 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:21.018850 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:21.018858 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:21.019284 (+ 426us) client_negotiation.cc:769] Sending connection context
0807 06:58:21.020304 (+ 1020us) client_negotiation.cc:240] Negotiation successful
0807 06:58:21.020830 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":301,"threads_started":1}
I20260807 06:58:21.023919 30195 heartbeater.cc:347] Connected to a master server at 127.10.191.190:37317
I20260807 06:58:21.024245 30195 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:21.025188 30195 heartbeater.cc:511] Master 127.10.191.190:37317 requested a full tablet report, sending...
I20260807 06:58:21.027285 29486 ts_manager.cc:194] Registered new tserver with Master: df00b65eba124bae944ef94aeaa8e84a (127.10.191.131:37667)
I20260807 06:58:21.028508 29486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:57207
I20260807 06:58:21.034900 30199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.003886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39510 (local address 127.10.191.190:37317)
0807 06:58:21.019746 (+ 15860us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.019752 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.019769 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:58:21.019816 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.019821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.019899 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.020013 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:21.022228 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.023395 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.024891 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.025392 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.025534 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.028850 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:21.028857 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:21.028862 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:21.028900 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:21.032347 (+ 3447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.033045 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.033051 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.033054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.033252 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.033628 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.033632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.033635 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.033931 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:21.034193 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.034363 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.034583 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15745,"thread_start_us":15817,"threads_started":1}
I20260807 06:58:21.037573 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:58:21.053587 30199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.040890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39522 (local address 127.10.191.190:37317)
0807 06:58:21.041141 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.041149 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.041637 (+ 488us) server_negotiation.cc:407] Connection header received
0807 06:58:21.041887 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.041892 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.041981 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.042066 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:21.043591 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.044166 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.045654 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.046014 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.046142 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.048526 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:21.048530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:21.048533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:21.048560 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:21.050858 (+ 2298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.051559 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.051564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.051567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.051749 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.052251 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.052256 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.052259 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.052581 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:21.052813 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.053094 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.053287 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:58:21.058878 29486 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39522:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:58:21.069940 29486 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:58:21.100229 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.084431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:42201 (local address 127.0.0.1:59246)
0807 06:58:21.085372 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.085403 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:21.085558 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:21.092080 (+ 6522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:21.092084 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:21.092121 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:21.092475 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.092490 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.094558 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.094566 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.097229 (+ 2663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.097244 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.099146 (+ 1902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.099153 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.099347 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.099413 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 06:58:21.099512 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 06:58:21.099721 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"mutex_wait_us":1,"thread_start_us":1489,"threads_started":1}
I20260807 06:58:21.100327 30222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.086267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.0.0.1:55728)
0807 06:58:21.086731 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.086748 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:21.086851 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:21.091138 (+ 4287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:21.091146 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:21.091192 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:21.091590 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.091603 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.093774 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.093779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.097560 (+ 3781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.097576 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.099436 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.099442 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.099638 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.099675 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 06:58:21.099748 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 06:58:21.099875 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":84,"thread_start_us":2844,"threads_started":1}
I20260807 06:58:21.101315 30227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.086768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55728 (local address 127.10.191.129:41905)
0807 06:58:21.089813 (+ 3045us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.089825 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.089861 (+ 36us) server_negotiation.cc:407] Connection header received
0807 06:58:21.089978 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.089989 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.090288 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.091811 (+ 1523us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:21.092125 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.093624 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.097753 (+ 4129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.099193 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.100603 (+ 1410us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.100762 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.100827 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.100971 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2866,"thread_start_us":2770,"threads_started":1}
I20260807 06:58:21.101953 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.084963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59246 (local address 127.10.191.130:42201)
0807 06:58:21.091459 (+ 6496us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.091468 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.091498 (+ 30us) server_negotiation.cc:407] Connection header received
0807 06:58:21.091605 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.091613 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.091846 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.092765 (+ 919us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:21.092967 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.094392 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.097419 (+ 3027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.098887 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.101169 (+ 2282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.101316 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.101390 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.101549 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6139,"thread_start_us":5988,"threads_started":1}
I20260807 06:58:21.104591 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.084447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:37667 (local address 127.0.0.1:46356)
0807 06:58:21.086144 (+ 1697us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.086160 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:21.086253 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:21.094278 (+ 8025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:21.094282 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:21.094307 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:21.094767 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.094784 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.099552 (+ 4768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.099556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.101606 (+ 2050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.101620 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.103887 (+ 2267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.103894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.104054 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.104084 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 06:58:21.104149 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 06:58:21.104274 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1585,"thread_start_us":742,"threads_started":1}
I20260807 06:58:21.105661 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.085013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46356 (local address 127.10.191.131:37667)
0807 06:58:21.090947 (+ 5934us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.093746 (+ 2799us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.093790 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:58:21.093882 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.093889 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.094091 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.094904 (+ 813us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:21.096717 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.098360 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.101849 (+ 3489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.103656 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.104957 (+ 1301us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.105132 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.105204 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.105342 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5775,"thread_start_us":5599,"threads_started":1}
I20260807 06:58:21.105501 29682 tablet_service.cc:1467] Processing CreateTablet for tablet 8fc201928347417a820d7483356e92b2 (DEFAULT_TABLE table=test-table [id=fe12d7459a78480a9189d3a4a226dfe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:21.106287 29910 tablet_service.cc:1467] Processing CreateTablet for tablet 8fc201928347417a820d7483356e92b2 (DEFAULT_TABLE table=test-table [id=fe12d7459a78480a9189d3a4a226dfe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:21.107540 29682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fc201928347417a820d7483356e92b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:21.108776 29910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fc201928347417a820d7483356e92b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:21.108916 30100 tablet_service.cc:1467] Processing CreateTablet for tablet 8fc201928347417a820d7483356e92b2 (DEFAULT_TABLE table=test-table [id=fe12d7459a78480a9189d3a4a226dfe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:21.110173 30100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fc201928347417a820d7483356e92b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:21.112092 29997 heartbeater.cc:503] Master 127.10.191.190:37317 was elected leader, sending a full tablet report...
I20260807 06:58:21.130852 30229 tablet_bootstrap.cc:492] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: Bootstrap starting.
I20260807 06:58:21.137054 30230 tablet_bootstrap.cc:492] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: Bootstrap starting.
I20260807 06:58:21.137734 30228 tablet_bootstrap.cc:492] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e: Bootstrap starting.
I20260807 06:58:21.138799 30229 tablet_bootstrap.cc:654] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:21.140103 30229 log.cc:824] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:21.141089 30228 tablet_bootstrap.cc:654] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:21.142554 30228 log.cc:824] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:21.143162 30230 tablet_bootstrap.cc:654] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:21.144285 30230 log.cc:824] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:21.146775 30229 tablet_bootstrap.cc:492] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: No bootstrap required, opened a new log
I20260807 06:58:21.147158 30229 ts_tablet_manager.cc:1397] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.000s
I20260807 06:58:21.149556 30228 tablet_bootstrap.cc:492] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e: No bootstrap required, opened a new log
I20260807 06:58:21.149847 30228 ts_tablet_manager.cc:1397] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20260807 06:58:21.158905 30229 raft_consensus.cc:348] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } }
I20260807 06:58:21.159385 30230 tablet_bootstrap.cc:492] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: No bootstrap required, opened a new log
I20260807 06:58:21.159409 30229 raft_consensus.cc:374] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:21.159584 30229 raft_consensus.cc:729] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df00b65eba124bae944ef94aeaa8e84a, State: Initialized, Role: FOLLOWER
I20260807 06:58:21.159649 30230 ts_tablet_manager.cc:1397] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.006s
I20260807 06:58:21.160351 30229 consensus_queue.cc:260] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } }
I20260807 06:58:21.160671 30228 raft_consensus.cc:348] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } }
I20260807 06:58:21.161151 30228 raft_consensus.cc:374] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:21.161260 30228 raft_consensus.cc:729] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66d2429ee16445a1b7e051562dcf806e, State: Initialized, Role: FOLLOWER
I20260807 06:58:21.162045 30228 consensus_queue.cc:260] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } }
I20260807 06:58:21.167343 30228 ts_tablet_manager.cc:1428] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e: Time spent starting tablet: real 0.017s user 0.003s sys 0.013s
I20260807 06:58:21.167752 29792 heartbeater.cc:503] Master 127.10.191.190:37317 was elected leader, sending a full tablet report...
I20260807 06:58:21.169256 30230 raft_consensus.cc:348] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } }
I20260807 06:58:21.169621 30230 raft_consensus.cc:374] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:21.169703 30230 raft_consensus.cc:729] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe8dfa9ac8964ba297506c54919b1df0, State: Initialized, Role: FOLLOWER
I20260807 06:58:21.170269 30230 consensus_queue.cc:260] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } }
I20260807 06:58:21.175307 30195 heartbeater.cc:503] Master 127.10.191.190:37317 was elected leader, sending a full tablet report...
I20260807 06:58:21.176074 30229 ts_tablet_manager.cc:1428] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: Time spent starting tablet: real 0.029s user 0.013s sys 0.012s
I20260807 06:58:21.177717 30230 ts_tablet_manager.cc:1428] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: Time spent starting tablet: real 0.018s user 0.009s sys 0.008s
W20260807 06:58:21.194213 29793 tablet.cc:2369] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:58:21.195492 30243 raft_consensus.cc:482] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:58:21.195786 30243 raft_consensus.cc:504] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } }
I20260807 06:58:21.197638 30243 leader_election.cc:288] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df00b65eba124bae944ef94aeaa8e84a (127.10.191.131:37667), 66d2429ee16445a1b7e051562dcf806e (127.10.191.129:41905)
I20260807 06:58:21.205737 30227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.198304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:59593 (local address 127.10.191.129:41905)
0807 06:58:21.198500 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.198506 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.199756 (+ 1250us) server_negotiation.cc:407] Connection header received
0807 06:58:21.199966 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.199984 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.200042 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.200137 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:21.200720 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.201859 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.204050 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.204760 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.204947 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.205023 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.205345 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.205464 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:58:21.205845 30244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.197993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.10.191.130:59593)
0807 06:58:21.199655 (+ 1662us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.199668 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:21.199812 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:21.200159 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:21.200163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:21.200188 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:21.200550 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.200561 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.202011 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.202016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.203909 (+ 1893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.203920 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.204986 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.204992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.205177 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.205199 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 06:58:21.205318 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 06:58:21.205437 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1546,"mutex_wait_us":48,"thread_start_us":1339,"threads_started":1}
I20260807 06:58:21.206089 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.198669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:51853 (local address 127.10.191.131:37667)
0807 06:58:21.198904 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.198912 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.199203 (+ 291us) server_negotiation.cc:407] Connection header received
0807 06:58:21.199399 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.199405 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.199477 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.199534 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:21.200362 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.201358 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.203756 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.204882 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.205017 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.205125 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.205729 (+ 604us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.205861 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 06:58:21.206923 29708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fc201928347417a820d7483356e92b2" candidate_uuid: "fe8dfa9ac8964ba297506c54919b1df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d2429ee16445a1b7e051562dcf806e" is_pre_election: true
I20260807 06:58:21.207140 30246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.197990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:37667 (local address 127.10.191.130:51853)
0807 06:58:21.199052 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.199072 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:21.199218 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:21.199744 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:21.199749 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:21.199775 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:21.200170 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.200181 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.201493 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.201498 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.203570 (+ 2072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:21.203585 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.205304 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.205312 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:21.205532 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.205564 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 06:58:21.206619 (+ 1055us) client_negotiation.cc:240] Negotiation successful
0807 06:58:21.206764 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"mutex_wait_us":1,"thread_start_us":901,"threads_started":1}
I20260807 06:58:21.207484 29708 raft_consensus.cc:2454] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8dfa9ac8964ba297506c54919b1df0 in term 0.
I20260807 06:58:21.208235 29838 leader_election.cc:302] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66d2429ee16445a1b7e051562dcf806e, fe8dfa9ac8964ba297506c54919b1df0; no voters:
I20260807 06:58:21.208323 30132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fc201928347417a820d7483356e92b2" candidate_uuid: "fe8dfa9ac8964ba297506c54919b1df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df00b65eba124bae944ef94aeaa8e84a" is_pre_election: true
I20260807 06:58:21.208621 30243 raft_consensus.cc:2781] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:58:21.208786 30243 raft_consensus.cc:482] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:58:21.208904 30243 raft_consensus.cc:3037] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:21.208895 30132 raft_consensus.cc:2454] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe8dfa9ac8964ba297506c54919b1df0 in term 0.
I20260807 06:58:21.211323 30243 raft_consensus.cc:504] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } }
I20260807 06:58:21.211966 30243 leader_election.cc:288] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [CANDIDATE]: Term 1 election: Requested vote from peers df00b65eba124bae944ef94aeaa8e84a (127.10.191.131:37667), 66d2429ee16445a1b7e051562dcf806e (127.10.191.129:41905)
I20260807 06:58:21.212339 30132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fc201928347417a820d7483356e92b2" candidate_uuid: "fe8dfa9ac8964ba297506c54919b1df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df00b65eba124bae944ef94aeaa8e84a"
I20260807 06:58:21.212527 30132 raft_consensus.cc:3037] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:21.212852 29708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fc201928347417a820d7483356e92b2" candidate_uuid: "fe8dfa9ac8964ba297506c54919b1df0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66d2429ee16445a1b7e051562dcf806e"
I20260807 06:58:21.213047 29708 raft_consensus.cc:3037] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:21.214849 30132 raft_consensus.cc:2454] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8dfa9ac8964ba297506c54919b1df0 in term 1.
I20260807 06:58:21.215243 29833 leader_election.cc:302] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df00b65eba124bae944ef94aeaa8e84a, fe8dfa9ac8964ba297506c54919b1df0; no voters:
I20260807 06:58:21.215523 30243 raft_consensus.cc:2781] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:58:21.216017 30243 raft_consensus.cc:686] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 1 LEADER]: Becoming Leader. State: Replica: fe8dfa9ac8964ba297506c54919b1df0, State: Running, Role: LEADER
I20260807 06:58:21.216373 29708 raft_consensus.cc:2454] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe8dfa9ac8964ba297506c54919b1df0 in term 1.
I20260807 06:58:21.216549 30243 consensus_queue.cc:237] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } }
I20260807 06:58:21.221494 29486 catalog_manager.cc:5495] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe8dfa9ac8964ba297506c54919b1df0 (127.10.191.130). New cstate: current_term: 1 leader_uuid: "fe8dfa9ac8964ba297506c54919b1df0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe8dfa9ac8964ba297506c54919b1df0" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 } health_report { overall_health: UNKNOWN } } }
W20260807 06:58:21.247828 30196 tablet.cc:2369] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:58:21.259539 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.253469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59256 (local address 127.10.191.130:42201)
0807 06:58:21.253700 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.253710 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.253778 (+ 68us) server_negotiation.cc:407] Connection header received
0807 06:58:21.254014 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.254019 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.254103 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.254388 (+ 285us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:58:21.254814 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.255611 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.257199 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.257643 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.257792 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.258333 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:58:21.258828 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:58:21.259019 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.259163 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.259247 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 06:58:21.268208 30132 raft_consensus.cc:1261] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [term 1 FOLLOWER]: Refusing update from remote peer fe8dfa9ac8964ba297506c54919b1df0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:21.269310 30247 consensus_queue.cc:1035] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df00b65eba124bae944ef94aeaa8e84a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:21.269714 29708 raft_consensus.cc:1261] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [term 1 FOLLOWER]: Refusing update from remote peer fe8dfa9ac8964ba297506c54919b1df0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:21.270596 30247 consensus_queue.cc:1035] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66d2429ee16445a1b7e051562dcf806e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 41905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:21.288277 30250 mvcc.cc:205] Tried to move back new op lower bound from 7315807851583672320 to 7315807851387293696. Current Snapshot: MvccSnapshot[applied={T|T < 7315807851583672320}]
I20260807 06:58:21.290028 30251 mvcc.cc:205] Tried to move back new op lower bound from 7315807851583672320 to 7315807851387293696. Current Snapshot: MvccSnapshot[applied={T|T < 7315807851583672320}]
I20260807 06:58:21.293727 30253 mvcc.cc:205] Tried to move back new op lower bound from 7315807851583672320 to 7315807851387293696. Current Snapshot: MvccSnapshot[applied={T|T < 7315807851583672320}]
I20260807 06:58:21.314036 29486 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39522:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:58:21.314333 29486 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39522:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:58:21.318583 29486 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d88aea16e4ba4005898097a3236ec1ed: Sending DeleteTablet for 3 replicas of tablet 8fc201928347417a820d7483356e92b2
I20260807 06:58:21.319607 29910 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fc201928347417a820d7483356e92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:21 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:59246
I20260807 06:58:21.319741 30100 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fc201928347417a820d7483356e92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:21 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:46356
I20260807 06:58:21.320436 29682 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fc201928347417a820d7483356e92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:21 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:55728
I20260807 06:58:21.326001 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 29533
I20260807 06:58:21.335038 30266 tablet_replica.cc:330] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e: stopping tablet replica
I20260807 06:58:21.335575 30266 raft_consensus.cc:2229] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:58:21.337723 30266 raft_consensus.cc:2258] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:21.341696 30266 ts_tablet_manager.cc:1905] T 8fc201928347417a820d7483356e92b2 P 66d2429ee16445a1b7e051562dcf806e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:21.349466 30265 tablet_replica.cc:330] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: stopping tablet replica
I20260807 06:58:21.349956 30265 raft_consensus.cc:2229] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:58:21.350734 30227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.326912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55740 (local address 127.10.191.129:41905)
0807 06:58:21.327096 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.327103 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.328532 (+ 1429us) server_negotiation.cc:407] Connection header received
0807 06:58:21.328603 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.328607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.328698 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.328784 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:21.336020 (+ 7236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.337246 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.338841 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.339551 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.339691 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.343415 (+ 3724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:21.343441 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:21.343457 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:21.343499 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:21.347403 (+ 3904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.348288 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.348300 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.348306 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.348496 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.348918 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.348925 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.348928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.349416 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:21.349746 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.350105 (+ 359us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.350336 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 06:58:21.350843 30264 tablet_replica.cc:330] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: stopping tablet replica
I20260807 06:58:21.351238 30264 raft_consensus.cc:2229] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:58:21.351372 29785 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:21.351964 30264 raft_consensus.cc:2258] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:21.361835 30265 raft_consensus.cc:2258] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:21.363957 30264 ts_tablet_manager.cc:1905] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:21.364046 30265 ts_tablet_manager.cc:1905] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:21.371016 30264 ts_tablet_manager.cc:1918] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:21.371167 30265 ts_tablet_manager.cc:1918] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:21.371343 30265 log.cc:1196] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/8fc201928347417a820d7483356e92b2
I20260807 06:58:21.371934 30265 ts_tablet_manager.cc:1939] T 8fc201928347417a820d7483356e92b2 P df00b65eba124bae944ef94aeaa8e84a: Deleting consensus metadata
I20260807 06:58:21.374364 29468 catalog_manager.cc:4841] TS df00b65eba124bae944ef94aeaa8e84a (127.10.191.131:37667): tablet 8fc201928347417a820d7483356e92b2 (table test-table [id=fe12d7459a78480a9189d3a4a226dfe6]) successfully deleted
I20260807 06:58:21.376331 30264 log.cc:1196] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/8fc201928347417a820d7483356e92b2
I20260807 06:58:21.377452 30264 ts_tablet_manager.cc:1939] T 8fc201928347417a820d7483356e92b2 P fe8dfa9ac8964ba297506c54919b1df0: Deleting consensus metadata
I20260807 06:58:21.379631 29471 catalog_manager.cc:4841] TS fe8dfa9ac8964ba297506c54919b1df0 (127.10.191.130:42201): tablet 8fc201928347417a820d7483356e92b2 (table test-table [id=fe12d7459a78480a9189d3a4a226dfe6]) successfully deleted
I20260807 06:58:21.462020 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 29533
I20260807 06:58:21.489899 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 29798
W20260807 06:58:21.489904 29471 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.191.129:41905 (error 108)
I20260807 06:58:21.491971 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.491479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.0.0.1:55750)
0807 06:58:21.491661 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.491782 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 06:58:21.492244 29471 catalog_manager.cc:4584] TS 66d2429ee16445a1b7e051562dcf806e (127.10.191.129:41905): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8fc201928347417a820d7483356e92b2: Network error: Client connection negotiation failed: client connection to 127.10.191.129:41905: connect: Connection refused (error 111)
I20260807 06:58:21.504058 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.491178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59260 (local address 127.10.191.130:42201)
0807 06:58:21.491388 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.491394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.491413 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:58:21.491516 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.491521 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.491594 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.491690 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:21.493122 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.493891 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.495065 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.495588 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.495708 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.498293 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:21.498304 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:21.498318 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:21.498368 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:21.501413 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.502135 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.502141 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.502143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.502276 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.502630 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.502640 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.502642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.502940 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:21.503253 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.503537 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.503772 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:58:21.504923 29991 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:21.545989 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.545569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.0.0.1:55756)
0807 06:58:21.545758 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.545854 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 06:58:21.546976 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.546612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.0.0.1:55768)
0807 06:58:21.546785 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.546861 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 06:58:21.607488 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.607034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.0.0.1:55776)
0807 06:58:21.607245 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.607333 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 06:58:21.608462 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.608147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.0.0.1:55782)
0807 06:58:21.608282 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.608353 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 06:58:21.611202 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 29798
I20260807 06:58:21.647400 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 30001
I20260807 06:58:21.662688 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.648218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46364 (local address 127.10.191.131:37667)
0807 06:58:21.648383 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:21.648387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:21.648441 (+ 54us) server_negotiation.cc:407] Connection header received
0807 06:58:21.648626 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:21.648629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:21.648716 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:21.648803 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:21.650583 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.651310 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.653508 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:21.653858 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:21.653943 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:21.656902 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:21.656916 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:21.656932 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:21.656964 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:21.659838 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.660722 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.660728 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.660730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.660855 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:21.661249 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:21.661252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:21.661253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:21.661579 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:21.661815 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:21.662191 (+ 376us) server_negotiation.cc:299] Negotiation successful
0807 06:58:21.662358 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 06:58:21.663348 30187 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:21.689302 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.688714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.0.0.1:55798)
0807 06:58:21.688894 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.688992 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 06:58:21.691046 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.689988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.0.0.1:55802)
0807 06:58:21.690892 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.690956 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":762}
I20260807 06:58:21.750655 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 30001
I20260807 06:58:21.777597 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 29447
I20260807 06:58:21.778831 29525 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:21.883697 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:21.883056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:41905 (local address 127.0.0.1:55814)
0807 06:58:21.883300 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:21.883431 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 06:58:21.883865 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 29447
I20260807 06:58:21.917511 11006 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 06:58:22.265203 11006 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 06:58:22.265463 11006 mini_ranger.cc:66] Stopping Ranger...
I20260807 06:58:22.611940 11006 mini_ranger.cc:68] Stopped Ranger
2026-08-07 06:58:22.612 UTC [28067] LOG: received smart shutdown request
2026-08-07 06:58:22.615 UTC [28067] LOG: background worker "logical replication launcher" (PID 28082) exited with exit code 1
2026-08-07 06:58:22.615 UTC [28071] LOG: shutting down
2026-08-07 06:58:22.752 UTC [28067] LOG: database system is shut down
2026-08-07T06:58:22Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51259 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:58:22 dist-test-slave-tfpf krb5kdc[30288](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:58:22 dist-test-slave-tfpf krb5kdc[30288](info): set up 2 sockets
Aug 07 06:58:22 dist-test-slave-tfpf krb5kdc[30288](info): commencing operation
krb5kdc: starting...
W20260807 06:58:24.117215 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.001s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:58:24 dist-test-slave-tfpf krb5kdc[30288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:58:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:58:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:58:24.378706 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42501
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:42501,127.10.191.189:35795,127.10.191.188:42351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:24.698689 30309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:24.698942 30309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:24.699029 30309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:24.705520 30309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:24.705631 30309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:24.705703 30309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:24.705802 30309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:24.705874 30309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:24.714869 30309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:42501,127.10.191.189:35795,127.10.191.188:42351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:24.715973 30309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:24.717242 30309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:24.728467 30320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:24.728510 30324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:24.728435 30321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:24.729362 30309 server_base.cc:1034] running on GCE node
I20260807 06:58:24.730113 30309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:24.731405 30309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:24.732621 30309 hybrid_clock.cc:648] HybridClock initialized: now 1786085904732592 us; error 43 us; skew 500 ppm
I20260807 06:58:24.732920 30309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:24 dist-test-slave-tfpf krb5kdc[30288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085904, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:24.740895 30309 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:58:24.742367 30309 webserver.cc:460] Webserver started at http://127.10.191.190:43903/ using document root <none> and password file <none>
I20260807 06:58:24.742986 30309 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:24.743131 30309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:24.743453 30309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:24.746341 30309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "e2aba0b198ab479dafcb648697df0e2d"
format_stamp: "Formatted at 2026-08-07 06:58:24 on dist-test-slave-tfpf"
server_key: "e3b22f2d43dda0e1603c81ef148a9679"
server_key_iv: "898648db40803e55995506c13c8b8405"
server_key_version: "encryptionkey@0"
I20260807 06:58:24.747172 30309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "e2aba0b198ab479dafcb648697df0e2d"
format_stamp: "Formatted at 2026-08-07 06:58:24 on dist-test-slave-tfpf"
server_key: "e3b22f2d43dda0e1603c81ef148a9679"
server_key_iv: "898648db40803e55995506c13c8b8405"
server_key_version: "encryptionkey@0"
I20260807 06:58:24.752022 30309 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 06:58:24.755249 30333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:24.756772 30309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 06:58:24.756944 30309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "e2aba0b198ab479dafcb648697df0e2d"
format_stamp: "Formatted at 2026-08-07 06:58:24 on dist-test-slave-tfpf"
server_key: "e3b22f2d43dda0e1603c81ef148a9679"
server_key_iv: "898648db40803e55995506c13c8b8405"
server_key_version: "encryptionkey@0"
I20260807 06:58:24.757193 30309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:24.770943 30309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:24.774749 30309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:24.775043 30309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:24.793807 30309 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:42501
I20260807 06:58:24.793846 30415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:42501 every 8 connection(s)
I20260807 06:58:24.795097 30309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:58:24.798799 30416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:24.801124 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 30309
I20260807 06:58:24.801384 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:58:24.802186 11006 external_mini_cluster.cc:1428] Setting key c998050769f78acb4a16abc53ea0bc53
I20260807 06:58:24.807646 30416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:58:24 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085904, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:24.833528 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:24.811416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42501 (local address 127.0.0.1:60270)
0807 06:58:24.812280 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:24.812338 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:24.814986 (+ 2648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:24.815852 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:24.815859 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:24.816622 (+ 763us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:24.817217 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:24.817242 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:24.819684 (+ 2442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:24.819688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:24.820744 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:24.820756 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:24.822095 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:24.822101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:24.822238 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:24.822932 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:24.822954 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:24.825181 (+ 2227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:24.829648 (+ 4467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:24.829658 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:24.829672 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:24.830050 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:24.830553 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:24.830557 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:24.830559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:24.830716 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:24.831775 (+ 1059us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:24.831781 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:24.831962 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 06:58:24.832160 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 06:58:24.832509 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":1,"spinlock_wait_cycles":21248,"thread_start_us":353,"threads_started":1}
I20260807 06:58:24.833616 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:24.811416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60270 (local address 127.10.191.190:42501)
0807 06:58:24.813171 (+ 1755us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:24.813176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:24.813217 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:58:24.815328 (+ 2111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:24.815336 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:24.815609 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:24.815763 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:24.817421 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:24.819434 (+ 2013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:24.820896 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:24.821875 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:24.822061 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:24.825416 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:24.825428 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:24.825445 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:24.825486 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:24.829510 (+ 4024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:24.830208 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:24.830219 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:24.830225 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:24.830432 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:24.830867 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:24.830874 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:24.830880 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:24.831626 (+ 746us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:24.831842 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:24.832384 (+ 542us) server_negotiation.cc:299] Negotiation successful
0807 06:58:24.832668 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":1529,"spinlock_wait_cycles":44800,"thread_start_us":1322,"threads_started":1}
WARNING: no policy specified for kudu/127.10.191.189@KRBTEST.COM; defaulting to no policy
I20260807 06:58:24.836377 30416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.189@KRBTEST.COM" created.
I20260807 06:58:24.837689 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:24.837264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39610)
0807 06:58:24.837464 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:24.837588 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 06:58:24.838052 30337 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
I20260807 06:58:24.839519 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:24.839210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39622)
0807 06:58:24.839339 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:24.839400 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 06:58:24.839809 30416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:35795: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab.
Entry for principal kudu/127.10.191.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab.
I20260807 06:58:24.865581 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.189:35795
--webserver_interface=127.10.191.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab
--principal=kudu/127.10.191.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:42501,127.10.191.189:35795,127.10.191.188:42351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:58:24.889297 30416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } attempt: 1
I20260807 06:58:24.890435 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:24.890035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39632)
0807 06:58:24.890225 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:24.890320 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 06:58:24.891368 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:24.891036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39634)
0807 06:58:24.891188 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:24.891251 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 06:58:24.891542 30416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:35795: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
I20260807 06:58:24.959800 30416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } attempt: 2
I20260807 06:58:24.961010 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:24.960492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39644)
0807 06:58:24.960750 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:24.960882 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 06:58:24.962188 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:24.961824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39648)
0807 06:58:24.962020 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:24.962080 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260807 06:58:24.962352 30416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:35795: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
I20260807 06:58:25.053607 30416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } attempt: 3
I20260807 06:58:25.054734 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.054295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39664)
0807 06:58:25.054495 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.054597 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 06:58:25.055822 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.055451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39670)
0807 06:58:25.055621 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.055701 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 06:58:25.056039 30416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:35795: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
W20260807 06:58:25.196703 30425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:25.197058 30425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:25.197253 30425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 06:58:25.199263 30416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } attempt: 4
I20260807 06:58:25.200320 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.199829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39678)
0807 06:58:25.200085 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.200194 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260807 06:58:25.201269 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.200901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39680)
0807 06:58:25.201035 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.201164 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 06:58:25.201462 30416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:35795: Network error: Client connection negotiation failed: client connection to 127.10.191.189:35795: connect: Connection refused (error 111)
W20260807 06:58:25.203931 30425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:25.204053 30425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:25.204157 30425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:25.204255 30425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:25.204314 30425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:25.213208 30425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:42501,127.10.191.189:35795,127.10.191.188:42351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab
--principal=kudu/127.10.191.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.189:35795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.191.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:25.214396 30425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:25.215632 30425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:25.227882 30433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:25.227934 30431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:25.227975 30430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:25.230295 30425 server_base.cc:1034] running on GCE node
I20260807 06:58:25.231060 30425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:25.232282 30425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:25.233501 30425 hybrid_clock.cc:648] HybridClock initialized: now 1786085905233460 us; error 51 us; skew 500 ppm
I20260807 06:58:25.233824 30425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085905, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:25.236871 30425 init.cc:377] Logged in from keytab as kudu/127.10.191.189@KRBTEST.COM (short username kudu)
I20260807 06:58:25.238415 30425 webserver.cc:460] Webserver started at http://127.10.191.189:46559/ using document root <none> and password file <none>
I20260807 06:58:25.239115 30425 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:25.239292 30425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:25.239594 30425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:25.242422 30425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/data/instance:
uuid: "a0141f23c911419dadf50323543d35b3"
format_stamp: "Formatted at 2026-08-07 06:58:25 on dist-test-slave-tfpf"
server_key: "efb3c84812a4c3c16d6ca7ef224da54b"
server_key_iv: "b82037ae141b8f8ba2c0a6e6c559534c"
server_key_version: "encryptionkey@0"
I20260807 06:58:25.243148 30425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/wal/instance:
uuid: "a0141f23c911419dadf50323543d35b3"
format_stamp: "Formatted at 2026-08-07 06:58:25 on dist-test-slave-tfpf"
server_key: "efb3c84812a4c3c16d6ca7ef224da54b"
server_key_iv: "b82037ae141b8f8ba2c0a6e6c559534c"
server_key_version: "encryptionkey@0"
I20260807 06:58:25.248016 30425 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 06:58:25.251317 30443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:25.252652 30425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:25.252852 30425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/wal
uuid: "a0141f23c911419dadf50323543d35b3"
format_stamp: "Formatted at 2026-08-07 06:58:25 on dist-test-slave-tfpf"
server_key: "efb3c84812a4c3c16d6ca7ef224da54b"
server_key_iv: "b82037ae141b8f8ba2c0a6e6c559534c"
server_key_version: "encryptionkey@0"
I20260807 06:58:25.253046 30425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:25.281737 30425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:25.286027 30425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:25.286276 30425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:25.304754 30425 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.189:35795
I20260807 06:58:25.304790 30523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.189:35795 every 8 connection(s)
I20260807 06:58:25.306036 30425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
I20260807 06:58:25.309640 30524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:25.310663 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 30425
I20260807 06:58:25.310873 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-1/wal/instance
I20260807 06:58:25.311340 11006 external_mini_cluster.cc:1428] Setting key c599e262388ee9eb47468dc508678f61
I20260807 06:58:25.316569 30524 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085905, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:25.338902 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.319595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60282 (local address 127.10.191.190:42501)
0807 06:58:25.319766 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.319769 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.320914 (+ 1145us) server_negotiation.cc:407] Connection header received
0807 06:58:25.322821 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.322828 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.322917 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.323032 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.325108 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.325771 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.328278 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.328701 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.328805 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.332672 (+ 3867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.332677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.332680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.332711 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.335400 (+ 2689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.336252 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.336259 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.336262 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.336386 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.336864 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.336869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.336873 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.337222 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.337391 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.338240 (+ 849us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.338572 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:58:25.339753 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.320020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42501 (local address 127.0.0.1:60282)
0807 06:58:25.320730 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.320771 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:25.322537 (+ 1766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:25.323288 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:25.323302 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:25.324055 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:25.324875 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.324901 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.325941 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.325949 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.328117 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.328135 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.328930 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.328939 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.329236 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.329895 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:25.329926 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:25.332456 (+ 2530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:25.335548 (+ 3092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.335556 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.335570 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.336126 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.336498 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.336505 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.336508 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.336711 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.337362 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:25.337372 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:25.337701 (+ 329us) client_negotiation.cc:769] Sending connection context
0807 06:58:25.338062 (+ 361us) client_negotiation.cc:240] Negotiation successful
0807 06:58:25.338547 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":332,"threads_started":1}
WARNING: no policy specified for kudu/127.10.191.188@KRBTEST.COM; defaulting to no policy
I20260807 06:58:25.341526 30524 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.188@KRBTEST.COM" created.
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085905, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 06:58:25.356761 30529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.342320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39694 (local address 127.10.191.189:35795)
0807 06:58:25.342993 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.342998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.343023 (+ 25us) server_negotiation.cc:407] Connection header received
0807 06:58:25.343108 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.343119 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.343336 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.343528 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.344178 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.345883 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.346935 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.347882 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.348032 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.350860 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.350875 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.350890 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.350931 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.353874 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.354740 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.354746 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.354748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.354849 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.355265 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.355268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.355269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.355546 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.355697 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.356132 (+ 435us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.356404 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":122,"server-negotiator.queue_time_us":476,"thread_start_us":308,"threads_started":1}
I20260807 06:58:25.356837 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.342252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39694)
0807 06:58:25.342496 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.342523 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:25.342601 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:25.343551 (+ 950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:25.343554 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:25.343892 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:25.344026 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.344033 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.346024 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.346027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.346794 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.346804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.348030 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.348034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.348233 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.348776 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:25.348792 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:25.350648 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:25.354008 (+ 3360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.354015 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.354021 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.354604 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.354948 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.354955 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.354961 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.355141 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.355683 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:25.355689 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:25.355859 (+ 170us) client_negotiation.cc:769] Sending connection context
0807 06:58:25.356005 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 06:58:25.356307 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":2}
I20260807 06:58:25.359362 30524 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:58:25.360703 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.360137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40506)
0807 06:58:25.360369 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.360521 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 06:58:25.361021 30447 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
I20260807 06:58:25.362800 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.362320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40514)
0807 06:58:25.362530 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.362651 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 06:58:25.363019 30524 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:42351: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab.
Entry for principal kudu/127.10.191.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab.
I20260807 06:58:25.376407 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.188:42351
--webserver_interface=127.10.191.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab
--principal=kudu/127.10.191.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:42501,127.10.191.189:35795,127.10.191.188:42351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:58:25.412364 30524 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } attempt: 1
I20260807 06:58:25.413707 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.413152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40526)
0807 06:58:25.413374 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.413500 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 06:58:25.414840 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.414432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40528)
0807 06:58:25.414605 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.414704 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 06:58:25.415109 30524 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:42351: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
I20260807 06:58:25.483378 30524 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } attempt: 2
I20260807 06:58:25.484831 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.484173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40540)
0807 06:58:25.484441 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.484577 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 06:58:25.486070 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.485713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40554)
0807 06:58:25.485857 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.485931 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 06:58:25.486501 30524 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:42351: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
I20260807 06:58:25.500706 30416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } attempt: 5
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085904, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 06:58:25.514402 30529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.501601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39706 (local address 127.10.191.189:35795)
0807 06:58:25.501779 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.501785 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.501806 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:58:25.501981 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.501989 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.502101 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.503333 (+ 1232us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.503462 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.504129 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.505273 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.505724 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.505879 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.509284 (+ 3405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.509289 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.509293 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.509324 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.511848 (+ 2524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.512489 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.512495 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.512498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.512624 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.512982 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.512987 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.512990 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.513309 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.513457 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.513895 (+ 438us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.514101 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:58:25.514410 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.501404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39706)
0807 06:58:25.501597 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.501619 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:25.501786 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:25.502277 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:25.502282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:25.502816 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:25.503158 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.503171 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.504287 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.504292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.505146 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.505158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.505911 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.505917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.506112 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.506789 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:25.506807 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:25.509050 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:25.511990 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.511995 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.511999 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.512376 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.512731 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.512736 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.512739 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.512875 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.513424 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:25.513428 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:25.513580 (+ 152us) client_negotiation.cc:769] Sending connection context
0807 06:58:25.513790 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 06:58:25.514093 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 06:58:25.515827 30416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } has no permanent_uuid. Determining permanent_uuid...
I20260807 06:58:25.516968 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.516578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40562)
0807 06:58:25.516762 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.516847 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 06:58:25.517998 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.517683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40578)
0807 06:58:25.517836 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.517898 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 06:58:25.518255 30416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:42351: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
I20260807 06:58:25.569496 30416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } attempt: 1
I20260807 06:58:25.570727 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.570261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40594)
0807 06:58:25.570467 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.570559 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 06:58:25.571724 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.571379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40598)
0807 06:58:25.571531 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.571620 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 06:58:25.571954 30416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:42351: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
I20260807 06:58:25.577715 30524 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } attempt: 3
I20260807 06:58:25.578696 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.578304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40602)
0807 06:58:25.578475 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.578557 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 06:58:25.579725 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.579323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40606)
0807 06:58:25.579559 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.579629 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260807 06:58:25.579922 30524 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:42351: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
I20260807 06:58:25.640189 30416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } attempt: 2
I20260807 06:58:25.641498 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.640949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40618)
0807 06:58:25.641223 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.641316 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 06:58:25.642586 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.642227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40622)
0807 06:58:25.642394 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.642475 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 06:58:25.642804 30416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:42351: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
W20260807 06:58:25.709375 30532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:25.709661 30532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:25.709805 30532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:25.715991 30532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:25.716111 30532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:25.716236 30532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:25.716329 30532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:25.716413 30532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:25.723129 30524 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } attempt: 4
I20260807 06:58:25.724200 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.723734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40630)
0807 06:58:25.723967 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.724056 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 06:58:25.725244 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.724881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40640)
0807 06:58:25.725044 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.725144 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260807 06:58:25.725500 30524 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:42351: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
I20260807 06:58:25.725823 30532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:42501,127.10.191.189:35795,127.10.191.188:42351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab
--principal=kudu/127.10.191.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.188:42351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.191.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:25.726950 30532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:25.728214 30532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:25.739243 30542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:25.739281 30543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:25.739177 30546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:25.740074 30532 server_base.cc:1034] running on GCE node
I20260807 06:58:25.740828 30532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:25.742172 30532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:25.743388 30532 hybrid_clock.cc:648] HybridClock initialized: now 1786085905743345 us; error 51 us; skew 500 ppm
I20260807 06:58:25.743706 30532 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085905, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:25.746706 30532 init.cc:377] Logged in from keytab as kudu/127.10.191.188@KRBTEST.COM (short username kudu)
I20260807 06:58:25.748070 30532 webserver.cc:460] Webserver started at http://127.10.191.188:44505/ using document root <none> and password file <none>
I20260807 06:58:25.748677 30532 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:25.748783 30532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:25.749119 30532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:25.749013 30416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } attempt: 3
I20260807 06:58:25.750144 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.749582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40648)
0807 06:58:25.749796 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.749898 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 06:58:25.751245 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.750830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40650)
0807 06:58:25.751038 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.751126 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260807 06:58:25.751500 30416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:42351: Network error: Client connection negotiation failed: client connection to 127.10.191.188:42351: connect: Connection refused (error 111)
I20260807 06:58:25.752420 30532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/data/instance:
uuid: "e9442c338373450e96a8e78d30b66f28"
format_stamp: "Formatted at 2026-08-07 06:58:25 on dist-test-slave-tfpf"
server_key: "c22f38e59684a25cbe3379f200959caf"
server_key_iv: "434b7cc0625fa9923471d40422fb994d"
server_key_version: "encryptionkey@0"
I20260807 06:58:25.753293 30532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/wal/instance:
uuid: "e9442c338373450e96a8e78d30b66f28"
format_stamp: "Formatted at 2026-08-07 06:58:25 on dist-test-slave-tfpf"
server_key: "c22f38e59684a25cbe3379f200959caf"
server_key_iv: "434b7cc0625fa9923471d40422fb994d"
server_key_version: "encryptionkey@0"
I20260807 06:58:25.758059 30532 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:58:25.761379 30557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:25.762624 30532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:58:25.762804 30532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/wal
uuid: "e9442c338373450e96a8e78d30b66f28"
format_stamp: "Formatted at 2026-08-07 06:58:25 on dist-test-slave-tfpf"
server_key: "c22f38e59684a25cbe3379f200959caf"
server_key_iv: "434b7cc0625fa9923471d40422fb994d"
server_key_version: "encryptionkey@0"
I20260807 06:58:25.763000 30532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:25.775249 30532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:25.779438 30532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:25.779748 30532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:25.797797 30532 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.188:42351
I20260807 06:58:25.797816 30635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.188:42351 every 8 connection(s)
I20260807 06:58:25.799361 30532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
I20260807 06:58:25.800060 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 30532
I20260807 06:58:25.800262 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786085696003154-11006-0/minicluster-data/master-2/wal/instance
I20260807 06:58:25.800863 11006 external_mini_cluster.cc:1428] Setting key e80512cfbcae8876941953d82abfb685
I20260807 06:58:25.803954 30636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:25.814585 30636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085905, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:25.828451 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.803099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40658 (local address 127.10.191.188:42351)
0807 06:58:25.809517 (+ 6418us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.809530 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.810001 (+ 471us) server_negotiation.cc:407] Connection header received
0807 06:58:25.811711 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.811736 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.812158 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.812555 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.813905 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.815848 (+ 1943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.817257 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.818030 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.818239 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.821981 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.821987 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.821996 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.822031 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.824816 (+ 2785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.825498 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.825504 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.825508 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.825662 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.826106 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.826110 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.826112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.826528 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.826835 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.827246 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.827511 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6230,"thread_start_us":6028,"threads_started":1}
I20260807 06:58:25.830726 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.817266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60286 (local address 127.10.191.190:42501)
0807 06:58:25.817469 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.817474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.818278 (+ 804us) server_negotiation.cc:407] Connection header received
0807 06:58:25.818518 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.818529 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.818590 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.818687 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.819676 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.820280 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.821509 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.821926 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.822059 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.825218 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.825223 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.825225 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.825253 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.828106 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.828880 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.828890 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.828892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.829002 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.829384 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.829389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.829391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.829618 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.829754 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.830223 (+ 469us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.830428 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 06:58:25.831079 30642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.817280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42501 (local address 127.0.0.1:60286)
0807 06:58:25.818141 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.818181 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:25.818391 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:25.818741 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:25.818746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:25.819301 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:25.819540 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.819548 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.820419 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.820424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.821381 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.821392 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.822120 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.822129 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.822300 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.822970 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:25.822993 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:25.825007 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:25.828254 (+ 3247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.828274 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.828280 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.828768 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.829150 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.829154 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.829157 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.829278 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.829734 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:25.829740 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:25.829908 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 06:58:25.830103 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 06:58:25.830389 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":442,"threads_started":1}
I20260807 06:58:25.832413 30636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085905, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:25.845495 30642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.833023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:35795 (local address 127.0.0.1:39718)
0807 06:58:25.833183 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.833201 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:25.833288 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:25.833626 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:25.833630 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:25.833973 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:25.834177 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.834190 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.835095 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.835116 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.836185 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.836197 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.836927 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.836933 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.837252 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.837735 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:25.837762 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:25.839921 (+ 2159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:25.843160 (+ 3239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.843165 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.843168 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.843513 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.843952 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.843957 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.843960 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.844105 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.844603 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:25.844608 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:25.844759 (+ 151us) client_negotiation.cc:769] Sending connection context
0807 06:58:25.844920 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 06:58:25.845177 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 06:58:25.845829 30529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.833136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39718 (local address 127.10.191.189:35795)
0807 06:58:25.833325 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.833333 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.833351 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:58:25.833409 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.833414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.833480 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.833610 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.834329 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.834931 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.836315 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.836767 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.836858 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.840097 (+ 3239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.840104 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.840109 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.840147 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.843034 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.843647 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.843652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.843656 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.843836 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.844218 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.844224 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.844227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.844475 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.844639 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.845005 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.845227 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 06:58:25.846105 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.831372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60292 (local address 127.10.191.190:42501)
0807 06:58:25.831540 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.831545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.831558 (+ 13us) server_negotiation.cc:407] Connection header received
0807 06:58:25.831596 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.831600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.831661 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.831757 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.833264 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.833965 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.835252 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.835589 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.835664 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.840928 (+ 5264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.840933 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.840935 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.840967 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.843213 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.843916 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.843922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.843925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.844047 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.844419 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.844424 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.844428 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.844679 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.844989 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.845695 (+ 706us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.845852 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:58:25.846715 30636 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085905, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 06:58:25.858618 30642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.847642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40660)
0807 06:58:25.847908 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.847926 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:25.848030 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:25.848306 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:25.848310 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:25.848655 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:25.848795 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.848803 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.849780 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.849786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.850549 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.850559 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.851151 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.851156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.851317 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.851764 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:25.851778 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:25.853456 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:25.855961 (+ 2505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.855965 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.855968 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.856274 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.856752 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.856758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.856766 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.856934 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.857649 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:25.857653 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:25.857790 (+ 137us) client_negotiation.cc:769] Sending connection context
0807 06:58:25.857947 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 06:58:25.858245 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165}
I20260807 06:58:25.858829 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.847671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40660 (local address 127.10.191.188:42351)
0807 06:58:25.847858 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.847863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.848102 (+ 239us) server_negotiation.cc:407] Connection header received
0807 06:58:25.848129 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.848132 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.848173 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.848292 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.848924 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.849656 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.850671 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.851013 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.851138 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.853599 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.853603 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.853605 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.853629 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.855841 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.856382 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.856389 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.856394 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.856548 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.857164 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.857169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.857173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.857505 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.857669 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.858051 (+ 382us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.858390 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":135,"server-negotiator.queue_time_us":94}
I20260807 06:58:25.861804 30529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.847880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39728 (local address 127.10.191.189:35795)
0807 06:58:25.848039 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.848045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.848096 (+ 51us) server_negotiation.cc:407] Connection header received
0807 06:58:25.848287 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.848292 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.848354 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.848447 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.849723 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.850356 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.851412 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.851908 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.852030 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.856033 (+ 4003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.856038 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.856042 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.856078 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.859139 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.859866 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.859872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.859874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.860048 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.860399 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.860406 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.860411 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.860753 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.861000 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.861257 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.861514 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:58:25.864275 30636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28: Bootstrap starting.
I20260807 06:58:25.866173 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:58:25.868134 30636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:25.869383 30636 log.cc:824] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:25.872517 30636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28: No bootstrap required, opened a new log
I20260807 06:58:25.883649 30636 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } }
I20260807 06:58:25.884056 30636 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:25.884186 30636 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9442c338373450e96a8e78d30b66f28, State: Initialized, Role: FOLLOWER
I20260807 06:58:25.884895 30636 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } }
I20260807 06:58:25.890375 30656 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:25.890908 30656 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:58:25.891640 30636 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:58:25.895146 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.873439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40672 (local address 127.10.191.188:42351)
0807 06:58:25.873670 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.873677 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.877716 (+ 4039us) server_negotiation.cc:407] Connection header received
0807 06:58:25.877977 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.877984 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.878071 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.878153 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.880426 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.881477 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.883505 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.884146 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.884235 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.888228 (+ 3993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.888234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.888238 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.888273 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.892086 (+ 3813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.892865 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.892870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.892873 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.893016 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.893497 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.893502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.893506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.893829 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.894041 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.894600 (+ 559us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.894804 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:58:25.897190 30529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.871964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39734 (local address 127.10.191.189:35795)
0807 06:58:25.872134 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.872139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.877159 (+ 5020us) server_negotiation.cc:407] Connection header received
0807 06:58:25.877446 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.877451 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.877526 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.877608 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.880136 (+ 2528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.881166 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.883448 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.884042 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.884132 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.888262 (+ 4130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.888269 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.888273 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.888314 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.893410 (+ 5096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.894476 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.894483 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.894488 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.894655 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.895139 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.895146 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.895151 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.895549 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.895972 (+ 423us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.896552 (+ 580us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.896815 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 06:58:25.897979 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.877187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60300 (local address 127.10.191.190:42501)
0807 06:58:25.877355 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.877361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.877378 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:58:25.877428 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.877432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.877514 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.877606 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.880090 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.881085 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.883297 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.883891 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.883979 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.888834 (+ 4855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.888843 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.888850 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.888916 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.893228 (+ 4312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.894115 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.894122 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.894126 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.894265 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.894717 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.894724 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.894728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.895023 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.897037 (+ 2014us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.897190 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.897748 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260807 06:58:25.910141 30672 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:58:25.910254 30672 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:58:25.906854 30532 master_runner.cc:186] Error getting master registration for 127.10.191.190:42501: OK, instance_id { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" instance_seqno: 1786085904788390 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:58:25.919157 30532 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:58:25.928695 30416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } attempt: 4
Aug 07 06:58:25 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085904, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
I20260807 06:58:25.942276 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.929305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40678 (local address 127.10.191.188:42351)
0807 06:58:25.929475 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:25.929482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:25.929641 (+ 159us) server_negotiation.cc:407] Connection header received
0807 06:58:25.929817 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:25.929822 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:25.929884 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:25.929993 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:25.930788 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.931547 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.932732 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.933220 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.933353 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.936262 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:25.936273 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:25.936276 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:25.936304 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:25.939721 (+ 3417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.940327 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.940339 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.940341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.940458 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:25.940833 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:25.940838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:25.940841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:25.941163 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:25.941338 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:25.941734 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 06:58:25.941938 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:58:25.942277 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:25.929336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40678)
0807 06:58:25.929554 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:25.929573 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:25.929693 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:25.930018 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:25.930022 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:25.930466 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:25.930649 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.930658 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.931692 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.931697 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.932594 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:25.932605 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:25.933374 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:25.933379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:25.933558 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:25.934126 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:25.934142 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:25.936105 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:25.939840 (+ 3735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.939846 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.939850 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.940207 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.940567 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:25.940573 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:25.940579 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:25.940728 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:25.941312 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:25.941317 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:25.941467 (+ 150us) client_negotiation.cc:769] Sending connection context
0807 06:58:25.941617 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 06:58:25.941889 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260807 06:58:25.946448 30416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d: Bootstrap starting.
I20260807 06:58:25.949527 30416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:25.950500 30416 log.cc:824] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:25.953504 30416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d: No bootstrap required, opened a new log
I20260807 06:58:25.960175 30416 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } }
I20260807 06:58:25.960470 30416 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:25.960600 30416 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2aba0b198ab479dafcb648697df0e2d, State: Initialized, Role: FOLLOWER
I20260807 06:58:25.961205 30416 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } }
I20260807 06:58:25.962167 30675 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:25.962533 30675 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:58:25.963177 30416 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [sys.catalog]: configured and running, proceeding with master startup.
W20260807 06:58:25.973999 30696 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:58:25.974140 30696 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 06:58:25.973378 30309 master_runner.cc:186] Error getting master registration for 127.10.191.189:35795: OK, instance_id { permanent_uuid: "a0141f23c911419dadf50323543d35b3" instance_seqno: 1786085905299517 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 06:58:25.985831 30309 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 06:58:26.024753 30524 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } attempt: 5
W20260807 06:58:26.027827 30344 tablet.cc:2369] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:58:26.031643 30563 tablet.cc:2369] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 06:58:26 dist-test-slave-tfpf krb5kdc[30288](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085905, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
I20260807 06:58:26.042495 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:26.025370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:42351 (local address 127.0.0.1:40682)
0807 06:58:26.026429 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:26.026448 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:26.026569 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:26.027172 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:26.027179 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:26.027834 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:26.028047 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:26.028061 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:26.029623 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:26.029629 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:26.030919 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:26.030933 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:26.032051 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:26.032056 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:26.032253 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:26.032910 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:26.032932 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:26.035548 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:26.039778 (+ 4230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:26.039783 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:26.039788 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:26.040288 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:26.040710 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:26.040716 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:26.040721 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:26.040921 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:26.041587 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:26.041592 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:26.041741 (+ 149us) client_negotiation.cc:769] Sending connection context
0807 06:58:26.041892 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 06:58:26.042140 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193}
I20260807 06:58:26.042865 30641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:26.025912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40682 (local address 127.10.191.188:42351)
0807 06:58:26.026351 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:26.026362 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:26.026684 (+ 322us) server_negotiation.cc:407] Connection header received
0807 06:58:26.026750 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:26.026755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:26.026845 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:26.026950 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:26.028281 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:26.029442 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:26.031077 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:26.031742 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:26.031862 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:26.035736 (+ 3874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:26.035742 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:26.035747 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:26.035783 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:26.039577 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:26.040414 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:26.040420 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:26.040424 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:26.040584 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:26.041044 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:26.041050 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:26.041054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:26.041467 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:26.041617 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:26.042004 (+ 387us) server_negotiation.cc:299] Negotiation successful
0807 06:58:26.042243 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268}
I20260807 06:58:26.048655 30524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3: Bootstrap starting.
I20260807 06:58:26.052856 30524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:26.054261 30524 log.cc:824] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:26.059463 30524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3: No bootstrap required, opened a new log
I20260807 06:58:26.071188 30524 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } }
I20260807 06:58:26.071578 30524 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:26.071692 30524 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0141f23c911419dadf50323543d35b3, State: Initialized, Role: FOLLOWER
I20260807 06:58:26.072305 30524 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } }
I20260807 06:58:26.073199 30699 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:26.073633 30699 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:58:26.074402 30524 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:58:26.100500 30425 master_runner.cc:263] No leader master found from master a0141f23c911419dadf50323543d35b3
I20260807 06:58:26.100672 30425 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 06:58:26.103632 30718 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 06:58:26.103910 30718 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260807 06:58:26.289011 30452 tablet.cc:2369] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:58:26.291772 30675 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:58:26.292128 30675 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } }
I20260807 06:58:26.294866 30675 leader_election.cc:288] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0141f23c911419dadf50323543d35b3 (127.10.191.189:35795), e9442c338373450e96a8e78d30b66f28 (127.10.191.188:42351)
I20260807 06:58:26.296007 30597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2aba0b198ab479dafcb648697df0e2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9442c338373450e96a8e78d30b66f28" is_pre_election: true
I20260807 06:58:26.296654 30597 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2aba0b198ab479dafcb648697df0e2d in term 0.
I20260807 06:58:26.297613 30339 leader_election.cc:302] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2aba0b198ab479dafcb648697df0e2d, e9442c338373450e96a8e78d30b66f28; no voters:
I20260807 06:58:26.299012 30485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2aba0b198ab479dafcb648697df0e2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0141f23c911419dadf50323543d35b3" is_pre_election: true
I20260807 06:58:26.299618 30485 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2aba0b198ab479dafcb648697df0e2d in term 0.
I20260807 06:58:26.303615 30675 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:58:26.303791 30675 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:58:26.303907 30675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:26.316826 30675 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } }
I20260807 06:58:26.318200 30485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2aba0b198ab479dafcb648697df0e2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0141f23c911419dadf50323543d35b3"
I20260807 06:58:26.318436 30485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:26.321954 30485 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2aba0b198ab479dafcb648697df0e2d in term 1.
I20260807 06:58:26.322588 30337 leader_election.cc:302] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0141f23c911419dadf50323543d35b3, e2aba0b198ab479dafcb648697df0e2d; no voters:
I20260807 06:58:26.326452 30597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2aba0b198ab479dafcb648697df0e2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9442c338373450e96a8e78d30b66f28"
I20260807 06:58:26.326692 30597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:26.330498 30597 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2aba0b198ab479dafcb648697df0e2d in term 1.
I20260807 06:58:26.331267 30675 leader_election.cc:288] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [CANDIDATE]: Term 1 election: Requested vote from peers a0141f23c911419dadf50323543d35b3 (127.10.191.189:35795), e9442c338373450e96a8e78d30b66f28 (127.10.191.188:42351)
I20260807 06:58:26.331668 30675 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:58:26.332103 30675 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [term 1 LEADER]: Becoming Leader. State: Replica: e2aba0b198ab479dafcb648697df0e2d, State: Running, Role: LEADER
I20260807 06:58:26.332986 30675 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } }
I20260807 06:58:26.355259 30675 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2aba0b198ab479dafcb648697df0e2d. Latest consensus state: current_term: 1 leader_uuid: "e2aba0b198ab479dafcb648697df0e2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:26.355886 30675 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:26.365103 30725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:58:26.367612 30725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:58:26.375195 30597 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [term 1 FOLLOWER]: Refusing update from remote peer e2aba0b198ab479dafcb648697df0e2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:26.376197 30675 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:26.376688 30485 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [term 1 FOLLOWER]: Refusing update from remote peer e2aba0b198ab479dafcb648697df0e2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:26.377592 30675 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:26.400499 30656 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2aba0b198ab479dafcb648697df0e2d. Latest consensus state: current_term: 1 leader_uuid: "e2aba0b198ab479dafcb648697df0e2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:26.400812 30656 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:58:26.402094 30699 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2aba0b198ab479dafcb648697df0e2d. Latest consensus state: current_term: 1 leader_uuid: "e2aba0b198ab479dafcb648697df0e2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:26.402333 30699 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:58:26.409570 30728 mvcc.cc:205] Tried to move back new op lower bound from 7315807872503513088 to 7315807872388952064. Current Snapshot: MvccSnapshot[applied={T|T < 7315807872503513088}]
I20260807 06:58:26.415628 30720 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2aba0b198ab479dafcb648697df0e2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:26.415962 30720 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:26.416384 30720 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2aba0b198ab479dafcb648697df0e2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:26.416599 30720 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:26.417380 30656 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2aba0b198ab479dafcb648697df0e2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:26.417642 30656 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:58:26.419417 30699 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2aba0b198ab479dafcb648697df0e2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aba0b198ab479dafcb648697df0e2d" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42501 } } peers { permanent_uuid: "a0141f23c911419dadf50323543d35b3" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 35795 } } peers { permanent_uuid: "e9442c338373450e96a8e78d30b66f28" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 42351 } } }
I20260807 06:58:26.419683 30699 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 06:58:26.419785 30725 catalog_manager.cc:1347] Generated new cluster ID: 7c8d441c26984f3a8ac0882c3c4b3ff0
I20260807 06:58:26.419885 30725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:58:26.438603 30725 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:58:26.440004 30725 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:58:26.450327 30725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2aba0b198ab479dafcb648697df0e2d: Generated new TSK 0
I20260807 06:58:26.451195 30725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:58:26.912056 30672 catalog_manager.cc:1259] Loaded cluster ID: 7c8d441c26984f3a8ac0882c3c4b3ff0
I20260807 06:58:26.912153 30672 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28: loading cluster ID for follower catalog manager: success
I20260807 06:58:26.914701 30672 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28: acquiring CA information for follower catalog manager: success
I20260807 06:58:26.916262 30672 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e9442c338373450e96a8e78d30b66f28: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:58:27.106043 30718 catalog_manager.cc:1259] Loaded cluster ID: 7c8d441c26984f3a8ac0882c3c4b3ff0
I20260807 06:58:27.106149 30718 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3: loading cluster ID for follower catalog manager: success
I20260807 06:58:27.108575 30718 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3: acquiring CA information for follower catalog manager: success
I20260807 06:58:27.110431 30718 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a0141f23c911419dadf50323543d35b3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 06:58:27.538827 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 30309
I20260807 06:58:27.540269 30411 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:27.646334 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 30309
I20260807 06:58:27.675320 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 30425
I20260807 06:58:27.676492 30516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:27.800407 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 30425
I20260807 06:58:27.830307 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 30532
I20260807 06:58:27.831444 30629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:27.935388 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 30532
2026-08-07T06:58:27Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5070 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:58:28 dist-test-slave-tfpf krb5kdc[30747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:58:28 dist-test-slave-tfpf krb5kdc[30747](info): set up 2 sockets
Aug 07 06:58:28 dist-test-slave-tfpf krb5kdc[30747](info): commencing operation
krb5kdc: starting...
W20260807 06:58:29.175788 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:58:29 dist-test-slave-tfpf krb5kdc[30747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:58:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:58:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:58:29.452368 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:39069
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:40775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:39069
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:29.790912 30761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:29.791213 30761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:29.791342 30761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:29.798511 30761 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:29.798648 30761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:29.798755 30761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:29.798861 30761 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:29.798954 30761 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:29.808595 30761 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:40775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:39069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:39069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:29.809919 30761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:29.811259 30761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:29.823820 30770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:29.823771 30772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:29.824401 30769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:29.825222 30761 server_base.cc:1034] running on GCE node
I20260807 06:58:29.826030 30761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:29.827466 30761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:29.828722 30761 hybrid_clock.cc:648] HybridClock initialized: now 1786085909828656 us; error 48 us; skew 500 ppm
I20260807 06:58:29.829210 30761 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:29 dist-test-slave-tfpf krb5kdc[30747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085909, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:29.835177 30761 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:58:29.836712 30761 webserver.cc:460] Webserver started at http://127.10.191.190:39763/ using document root <none> and password file <none>
I20260807 06:58:29.837529 30761 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:29.837687 30761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:29.838011 30761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:29.841033 30761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "be3704526ec1417eb23d18d59d1c7848"
format_stamp: "Formatted at 2026-08-07 06:58:29 on dist-test-slave-tfpf"
server_key: "22bd8c551f32c536717327a66753051b"
server_key_iv: "8eb05c56a2da2bd16041285d5505b2b9"
server_key_version: "encryptionkey@0"
I20260807 06:58:29.841857 30761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "be3704526ec1417eb23d18d59d1c7848"
format_stamp: "Formatted at 2026-08-07 06:58:29 on dist-test-slave-tfpf"
server_key: "22bd8c551f32c536717327a66753051b"
server_key_iv: "8eb05c56a2da2bd16041285d5505b2b9"
server_key_version: "encryptionkey@0"
I20260807 06:58:29.846894 30761 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:58:29.850317 30782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:29.851594 30761 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:58:29.851789 30761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "be3704526ec1417eb23d18d59d1c7848"
format_stamp: "Formatted at 2026-08-07 06:58:29 on dist-test-slave-tfpf"
server_key: "22bd8c551f32c536717327a66753051b"
server_key_iv: "8eb05c56a2da2bd16041285d5505b2b9"
server_key_version: "encryptionkey@0"
I20260807 06:58:29.851994 30761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:29.869292 30761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:29.873518 30761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:29.873806 30761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:29.892109 30761 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:39069
I20260807 06:58:29.892136 30857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:39069 every 8 connection(s)
I20260807 06:58:29.893429 30761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:58:29.896895 30858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:29.901623 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 30761
I20260807 06:58:29.901875 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:58:29.902733 11006 external_mini_cluster.cc:1428] Setting key 0897a67f3518ef1c5b590d8c4d792f31
I20260807 06:58:29.908558 30858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848: Bootstrap starting.
I20260807 06:58:29.912343 30858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:29.913545 30858 log.cc:824] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:29.917025 30858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848: No bootstrap required, opened a new log
Aug 07 06:58:29 dist-test-slave-tfpf krb5kdc[30747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:29.924794 30858 raft_consensus.cc:348] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be3704526ec1417eb23d18d59d1c7848" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39069 } }
I20260807 06:58:29.925191 30858 raft_consensus.cc:374] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:29.925328 30858 raft_consensus.cc:729] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3704526ec1417eb23d18d59d1c7848, State: Initialized, Role: FOLLOWER
I20260807 06:58:29.925894 30858 consensus_queue.cc:260] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be3704526ec1417eb23d18d59d1c7848" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39069 } }
I20260807 06:58:29.926156 30858 raft_consensus.cc:388] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:58:29.926330 30858 raft_consensus.cc:482] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:58:29.926522 30858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:29.927006 30864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:29.904501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36244 (local address 127.10.191.190:39069)
0807 06:58:29.905378 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:29.905388 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:29.905431 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:58:29.907084 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:29.907106 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:29.907435 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:29.907776 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:29.909789 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:29.911145 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:29.913114 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:29.913881 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:29.914007 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:29.919178 (+ 5171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:29.919186 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:29.919203 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:29.919247 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:29.922534 (+ 3287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:29.923274 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:29.923280 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:29.923285 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:29.923484 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:29.923924 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:29.923931 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:29.923938 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:29.924416 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:29.924725 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:29.925207 (+ 482us) server_negotiation.cc:299] Negotiation successful
0807 06:58:29.925846 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":374,"threads_started":1}
I20260807 06:58:29.929610 30858 raft_consensus.cc:504] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be3704526ec1417eb23d18d59d1c7848" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39069 } }
I20260807 06:58:29.930123 30858 leader_election.cc:302] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be3704526ec1417eb23d18d59d1c7848; no voters:
I20260807 06:58:29.930863 30858 leader_election.cc:288] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:58:29.930962 30866 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:58:29.931082 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 06:58:29.932128 30866 raft_consensus.cc:686] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [term 1 LEADER]: Becoming Leader. State: Replica: be3704526ec1417eb23d18d59d1c7848, State: Running, Role: LEADER
I20260807 06:58:29.932755 30866 consensus_queue.cc:237] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be3704526ec1417eb23d18d59d1c7848" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39069 } }
I20260807 06:58:29.933145 30858 sys_catalog.cc:564] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:58:29.935961 30868 sys_catalog.cc:455] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be3704526ec1417eb23d18d59d1c7848" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be3704526ec1417eb23d18d59d1c7848" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39069 } } }
I20260807 06:58:29.936290 30868 sys_catalog.cc:458] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:29.936997 30869 sys_catalog.cc:455] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be3704526ec1417eb23d18d59d1c7848. Latest consensus state: current_term: 1 leader_uuid: "be3704526ec1417eb23d18d59d1c7848" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be3704526ec1417eb23d18d59d1c7848" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39069 } } }
I20260807 06:58:29.937417 30869 sys_catalog.cc:458] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:29.941975 30880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:58:29.946166 30880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:58:29.954195 30880 catalog_manager.cc:1347] Generated new cluster ID: 55d5cf789c17425fb1ca17c2b73b468f
I20260807 06:58:29.954305 30880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:58:29.986263 30880 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:58:29.987648 30880 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:58:29.993824 30880 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be3704526ec1417eb23d18d59d1c7848: Generated new TSK 0
I20260807 06:58:29.994817 30880 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 06:58:30.043701 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 30761
I20260807 06:58:30.044844 30850 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:30.141430 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 30761
2026-08-07T06:58:30Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2205 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:58:30 dist-test-slave-tfpf krb5kdc[30906](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:58:30 dist-test-slave-tfpf krb5kdc[30906](info): set up 2 sockets
Aug 07 06:58:30 dist-test-slave-tfpf krb5kdc[30906](info): commencing operation
krb5kdc: starting...
W20260807 06:58:31.395115 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:58:31 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:58:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:58:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:58:31.685683 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35999
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:35999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:32.025828 30923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:32.026103 30923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:32.026191 30923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:32.033195 30923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:32.033290 30923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:32.033335 30923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:32.033392 30923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:32.033428 30923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:32.042600 30923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:35999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:32.043776 30923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:32.045040 30923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:32.056910 30930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:32.056885 30931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:32.057260 30933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:32.058104 30923 server_base.cc:1034] running on GCE node
I20260807 06:58:32.058822 30923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:32.060161 30923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:32.061381 30923 hybrid_clock.cc:648] HybridClock initialized: now 1786085912061325 us; error 38 us; skew 500 ppm
I20260807 06:58:32.061729 30923 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:32 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085912, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:32.064751 30923 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:58:32.066231 30923 webserver.cc:460] Webserver started at http://127.10.191.190:40883/ using document root <none> and password file <none>
I20260807 06:58:32.066882 30923 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:32.067055 30923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:32.067368 30923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:32.070408 30923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "0e7fab30fcc56e06a0fb8d2871e8ea4f"
server_key_iv: "614980ac7f096e53b42c264099029e3f"
server_key_version: "encryptionkey@0"
I20260807 06:58:32.071254 30923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "0e7fab30fcc56e06a0fb8d2871e8ea4f"
server_key_iv: "614980ac7f096e53b42c264099029e3f"
server_key_version: "encryptionkey@0"
I20260807 06:58:32.076152 30923 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 06:58:32.079540 30941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:32.080844 30923 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 06:58:32.081032 30923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "0e7fab30fcc56e06a0fb8d2871e8ea4f"
server_key_iv: "614980ac7f096e53b42c264099029e3f"
server_key_version: "encryptionkey@0"
I20260807 06:58:32.081298 30923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:32.105880 30923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:32.109829 30923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:32.110116 30923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:32.129125 30923 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:35999
I20260807 06:58:32.129215 31015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:35999 every 8 connection(s)
I20260807 06:58:32.130532 30923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:58:32.132280 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 30923
I20260807 06:58:32.132520 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:58:32.133443 11006 external_mini_cluster.cc:1428] Setting key 2455811ad6ef442c8ad1a7025bc2c065
I20260807 06:58:32.135402 31016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 06:58:32 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:32.149230 31016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Bootstrap starting.
I20260807 06:58:32.153179 31016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:32.154356 31016 log.cc:824] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:32.157605 31016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: No bootstrap required, opened a new log
I20260807 06:58:32.157797 31019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:32.135594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36926 (local address 127.10.191.190:35999)
0807 06:58:32.136399 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:32.136409 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:32.136449 (+ 40us) server_negotiation.cc:407] Connection header received
0807 06:58:32.138193 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:32.138215 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:32.138576 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:32.138929 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:32.140721 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:32.142083 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:32.143987 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:32.144645 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:32.144802 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:32.149687 (+ 4885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:32.149696 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:32.149712 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:32.149755 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:32.153472 (+ 3717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:32.154136 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:32.154146 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:32.154159 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:32.154369 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:32.154762 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:32.154768 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:32.154772 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:32.155347 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:32.155604 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:32.156066 (+ 462us) server_negotiation.cc:299] Negotiation successful
0807 06:58:32.156451 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":598,"thread_start_us":377,"threads_started":1}
I20260807 06:58:32.165151 31016 raft_consensus.cc:348] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:32.165474 31016 raft_consensus.cc:374] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:32.165568 31016 raft_consensus.cc:729] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82b7878d3ba46d7b0bcb2fc8bba4f34, State: Initialized, Role: FOLLOWER
I20260807 06:58:32.166028 31016 consensus_queue.cc:260] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:32.166303 31016 raft_consensus.cc:388] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:58:32.166468 31016 raft_consensus.cc:482] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:58:32.166694 31016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:32.168817 31016 raft_consensus.cc:504] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:32.169334 31016 leader_election.cc:302] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b82b7878d3ba46d7b0bcb2fc8bba4f34; no voters:
I20260807 06:58:32.169867 31016 leader_election.cc:288] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:58:32.170025 31026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:58:32.170872 31026 raft_consensus.cc:686] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 1 LEADER]: Becoming Leader. State: Replica: b82b7878d3ba46d7b0bcb2fc8bba4f34, State: Running, Role: LEADER
I20260807 06:58:32.171442 31026 consensus_queue.cc:237] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:32.172006 31016 sys_catalog.cc:564] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:58:32.174192 31029 sys_catalog.cc:455] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b82b7878d3ba46d7b0bcb2fc8bba4f34. Latest consensus state: current_term: 1 leader_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } } }
I20260807 06:58:32.174571 31029 sys_catalog.cc:458] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:32.174736 31027 sys_catalog.cc:455] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } } }
I20260807 06:58:32.175087 31027 sys_catalog.cc:458] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:32.175748 31034 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:58:32.180994 31034 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:58:32.189005 31034 catalog_manager.cc:1347] Generated new cluster ID: b22b46e1542b4204a82efb03999e9f31
I20260807 06:58:32.189132 31034 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:58:32.209839 31034 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:58:32.211642 31034 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:58:32.232751 31034 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Generated new TSK 0
I20260807 06:58:32.233834 31034 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:58:32.311952 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35999
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:32.644235 31053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:32.644476 31053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:32.644562 31053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:32.651320 31053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:32.651405 31053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:32.651547 31053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:58:32.660733 31053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:32.662281 31053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:32.663618 31053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:32.677389 31065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:32.677433 31059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:32.677366 31060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:32.678393 31053 server_base.cc:1034] running on GCE node
I20260807 06:58:32.679051 31053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:32.680033 31053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:32.681248 31053 hybrid_clock.cc:648] HybridClock initialized: now 1786085912681197 us; error 62 us; skew 500 ppm
I20260807 06:58:32.681555 31053 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:32 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085912, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:32.684648 31053 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:58:32.686192 31053 webserver.cc:460] Webserver started at http://127.10.191.129:43177/ using document root <none> and password file <none>
I20260807 06:58:32.686896 31053 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:32.687040 31053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:32.687343 31053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:32.690237 31053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "c523efa47a524c7e98df15899567bf66"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "4538d9c887889b2b636dd695aebd0f74"
server_key_iv: "f1dc843bd0738b6e22f9fd832ff130ec"
server_key_version: "encryptionkey@0"
I20260807 06:58:32.691016 31053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "c523efa47a524c7e98df15899567bf66"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "4538d9c887889b2b636dd695aebd0f74"
server_key_iv: "f1dc843bd0738b6e22f9fd832ff130ec"
server_key_version: "encryptionkey@0"
I20260807 06:58:32.695938 31053 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 06:58:32.699311 31075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:32.700510 31053 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:32.700675 31053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "c523efa47a524c7e98df15899567bf66"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "4538d9c887889b2b636dd695aebd0f74"
server_key_iv: "f1dc843bd0738b6e22f9fd832ff130ec"
server_key_version: "encryptionkey@0"
I20260807 06:58:32.700867 31053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:32.725932 31053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:32.729728 31053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:32.730017 31053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:32.730908 31053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:32.732329 31053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:32.732426 31053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:32.732570 31053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:32.732641 31053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:32.765770 31053 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:45905
I20260807 06:58:32.765857 31228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:45905 every 8 connection(s)
I20260807 06:58:32.767087 31053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:58:32.767428 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 31053
I20260807 06:58:32.767661 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:58:32.768618 11006 external_mini_cluster.cc:1428] Setting key 6f12f3e2ada2b1014947fcbf8497255e
Aug 07 06:58:32 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085912, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:32.788872 31232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:32.770206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:52133 (local address 127.10.191.190:35999)
0807 06:58:32.770709 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:32.770716 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:32.772024 (+ 1308us) server_negotiation.cc:407] Connection header received
0807 06:58:32.774249 (+ 2225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:32.774255 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:32.774345 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:32.774459 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:32.775974 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:32.776692 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:32.778510 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:32.778970 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:32.779113 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:32.782547 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:32.782555 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:32.782563 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:32.782608 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:32.785648 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:32.786523 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:32.786526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:32.786529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:32.786644 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:32.787137 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:32.787140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:32.787142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:32.787394 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:32.787502 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:32.788442 (+ 940us) server_negotiation.cc:299] Negotiation successful
0807 06:58:32.788601 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":259,"threads_started":1}
I20260807 06:58:32.790364 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:32.770929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:52133)
0807 06:58:32.771864 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:32.771914 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:32.773982 (+ 2068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:32.774714 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:32.774723 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:32.775240 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:32.775803 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:32.775821 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:32.776872 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:32.776877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:32.778312 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:32.778329 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:32.779211 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:32.779220 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:32.779462 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:32.780161 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:32.780184 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:32.782323 (+ 2139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:32.785797 (+ 3474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:32.785808 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:32.785824 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:32.786406 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:32.786769 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:32.786777 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:32.786783 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:32.787023 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:32.787526 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:32.787536 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:32.788039 (+ 503us) client_negotiation.cc:769] Sending connection context
0807 06:58:32.788340 (+ 301us) client_negotiation.cc:240] Negotiation successful
0807 06:58:32.788918 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":385,"threads_started":1}
I20260807 06:58:32.791967 31230 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35999
I20260807 06:58:32.792297 31230 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:32.793200 31230 heartbeater.cc:511] Master 127.10.191.190:35999 requested a full tablet report, sending...
I20260807 06:58:32.795418 30967 ts_manager.cc:194] Registered new tserver with Master: c523efa47a524c7e98df15899567bf66 (127.10.191.129:45905)
I20260807 06:58:32.796847 30967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:52133
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:58:32.834450 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35999
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:33.182078 31238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:33.182405 31238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:33.182580 31238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:33.189602 31238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:33.189751 31238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:33.189908 31238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:58:33.198828 31238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:33.200003 31238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:33.201290 31238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:33.214087 31245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:33.214121 31249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:33.214035 31246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:33.215206 31238 server_base.cc:1034] running on GCE node
I20260807 06:58:33.215812 31238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:33.216804 31238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:33.218034 31238 hybrid_clock.cc:648] HybridClock initialized: now 1786085913217966 us; error 79 us; skew 500 ppm
I20260807 06:58:33.218360 31238 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:33 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085913, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:33.221402 31238 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:58:33.222792 31238 webserver.cc:460] Webserver started at http://127.10.191.130:35169/ using document root <none> and password file <none>
I20260807 06:58:33.223466 31238 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:33.223618 31238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:33.223928 31238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:33.226781 31238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "64921d1557d544b6837dce8342ecf3de"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "2b0e2e920da4a1d601db255dd48bc259"
server_key_iv: "1b28399fe77667750d7c02235df79869"
server_key_version: "encryptionkey@0"
I20260807 06:58:33.227556 31238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "64921d1557d544b6837dce8342ecf3de"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "2b0e2e920da4a1d601db255dd48bc259"
server_key_iv: "1b28399fe77667750d7c02235df79869"
server_key_version: "encryptionkey@0"
I20260807 06:58:33.232393 31238 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 06:58:33.235809 31257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:33.237143 31238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:33.237308 31238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "64921d1557d544b6837dce8342ecf3de"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "2b0e2e920da4a1d601db255dd48bc259"
server_key_iv: "1b28399fe77667750d7c02235df79869"
server_key_version: "encryptionkey@0"
I20260807 06:58:33.237512 31238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:33.252161 31238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:33.255846 31238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:33.256137 31238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:33.257151 31238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:33.258504 31238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:33.258616 31238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:33.258772 31238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:33.258846 31238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:33.290969 31238 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:46749
I20260807 06:58:33.290935 31435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:46749 every 8 connection(s)
I20260807 06:58:33.292281 31238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:58:33.302110 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 31238
I20260807 06:58:33.302330 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:58:33.303014 11006 external_mini_cluster.cc:1428] Setting key 012404b8278e8bfc2bf10f77fea1e873
Aug 07 06:58:33 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085913, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:33.312970 31441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.294945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:54303 (local address 127.10.191.190:35999)
0807 06:58:33.295380 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:33.295384 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:33.296369 (+ 985us) server_negotiation.cc:407] Connection header received
0807 06:58:33.298173 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:33.298177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:33.298244 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:33.298344 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:33.299726 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.300458 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.302033 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.302801 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.302956 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.307297 (+ 4341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:33.307301 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:33.307304 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:33.307334 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:33.309978 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:33.310664 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:33.310671 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:33.310674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:33.310807 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:33.311246 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:33.311249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:33.311251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:33.311490 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:33.311643 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:33.312342 (+ 699us) server_negotiation.cc:299] Negotiation successful
0807 06:58:33.312577 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":219,"threads_started":1}
I20260807 06:58:33.313948 31444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.295517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:54303)
0807 06:58:33.296203 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:33.296259 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:33.297920 (+ 1661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:33.298548 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:33.298556 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:33.299045 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:33.299572 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.299588 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.300592 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.300596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.301865 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.301878 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.303017 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.303022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.303282 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.304045 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:33.304087 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:33.307077 (+ 2990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:33.310125 (+ 3048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:33.310133 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:33.310146 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:33.310534 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:33.310920 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:33.310925 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:33.310929 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:33.311107 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:33.311619 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:33.311626 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:33.311960 (+ 334us) client_negotiation.cc:769] Sending connection context
0807 06:58:33.312248 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 06:58:33.312769 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":267,"threads_started":1}
I20260807 06:58:33.315313 31437 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35999
I20260807 06:58:33.315616 31437 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:33.316345 31437 heartbeater.cc:511] Master 127.10.191.190:35999 requested a full tablet report, sending...
I20260807 06:58:33.317878 30967 ts_manager.cc:194] Registered new tserver with Master: 64921d1557d544b6837dce8342ecf3de (127.10.191.130:46749)
I20260807 06:58:33.318673 30967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:54303
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:58:33.361950 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35999
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:33.688064 31447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:33.688375 31447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:33.688542 31447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:33.695117 31447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:33.695271 31447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:33.695441 31447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:58:33.703972 31447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:35999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:33.705178 31447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:33.706605 31447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:33.719277 31455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:33.719370 31456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:33.719309 31458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:33.722407 31447 server_base.cc:1034] running on GCE node
I20260807 06:58:33.722961 31447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:33.723862 31447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:33.725106 31447 hybrid_clock.cc:648] HybridClock initialized: now 1786085913725022 us; error 29 us; skew 500 ppm
I20260807 06:58:33.725396 31447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:33 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085913, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:33.728477 31447 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:58:33.729948 31447 webserver.cc:460] Webserver started at http://127.10.191.131:44387/ using document root <none> and password file <none>
I20260807 06:58:33.730618 31447 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:33.730715 31447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:33.730965 31447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:33.733824 31447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "d72fb83b7bd54cacb4e8baed68422cf9"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "32a79dff62ecaae66efba1963bd8ddc1"
server_key_iv: "30a92d7921ac8f7dff10ca6510054561"
server_key_version: "encryptionkey@0"
I20260807 06:58:33.734561 31447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "d72fb83b7bd54cacb4e8baed68422cf9"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "32a79dff62ecaae66efba1963bd8ddc1"
server_key_iv: "30a92d7921ac8f7dff10ca6510054561"
server_key_version: "encryptionkey@0"
I20260807 06:58:33.739584 31447 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:58:33.743046 31469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:33.744755 31447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:33.744890 31447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "d72fb83b7bd54cacb4e8baed68422cf9"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "32a79dff62ecaae66efba1963bd8ddc1"
server_key_iv: "30a92d7921ac8f7dff10ca6510054561"
server_key_version: "encryptionkey@0"
I20260807 06:58:33.745044 31447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:33.769631 31447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:33.773939 31447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:33.774179 31447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:33.775029 31447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:33.776242 31447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:33.776311 31447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:33.776391 31447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:33.776440 31447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:33.800715 31230 heartbeater.cc:503] Master 127.10.191.190:35999 was elected leader, sending a full tablet report...
I20260807 06:58:33.810277 31447 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:40975
I20260807 06:58:33.810330 31632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:40975 every 8 connection(s)
I20260807 06:58:33.811606 31447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:58:33.817452 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 31447
I20260807 06:58:33.817656 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:58:33.818156 11006 external_mini_cluster.cc:1428] Setting key 188db7d548c680cc44d18bbc11f2f7eb
Aug 07 06:58:33 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085913, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:33.831362 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.814371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:42887 (local address 127.10.191.190:35999)
0807 06:58:33.814893 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:33.814901 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:33.815840 (+ 939us) server_negotiation.cc:407] Connection header received
0807 06:58:33.817801 (+ 1961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:33.817806 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:33.817912 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:33.818033 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:33.819793 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.820790 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.822534 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.822907 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.823000 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.826148 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:33.826152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:33.826155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:33.826187 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:33.828773 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:33.829475 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:33.829478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:33.829480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:33.829601 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:33.829967 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:33.829970 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:33.829972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:33.830222 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:33.830328 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:33.830929 (+ 601us) server_negotiation.cc:299] Negotiation successful
0807 06:58:33.831089 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":236,"threads_started":1}
I20260807 06:58:33.832436 31636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.814964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:42887)
0807 06:58:33.815686 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:33.815734 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:33.817494 (+ 1760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:33.818292 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:33.818305 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:33.818808 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:33.819634 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.819653 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.820950 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.820954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.822400 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.822413 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.823085 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.823089 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.823274 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.823876 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:33.823897 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:33.825952 (+ 2055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:33.828893 (+ 2941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:33.828899 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:33.828909 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:33.829366 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:33.829698 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:33.829701 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:33.829703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:33.829870 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:33.830330 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:33.830335 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:33.830606 (+ 271us) client_negotiation.cc:769] Sending connection context
0807 06:58:33.830828 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 06:58:33.831173 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":287,"threads_started":1}
I20260807 06:58:33.833976 31633 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35999
I20260807 06:58:33.834282 31633 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:33.834980 31633 heartbeater.cc:511] Master 127.10.191.190:35999 requested a full tablet report, sending...
I20260807 06:58:33.836354 30966 ts_manager.cc:194] Registered new tserver with Master: d72fb83b7bd54cacb4e8baed68422cf9 (127.10.191.131:40975)
I20260807 06:58:33.837301 30966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:42887
I20260807 06:58:33.845885 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:58:33.862769 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.850584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36936 (local address 127.10.191.190:35999)
0807 06:58:33.850754 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:33.850758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:33.851225 (+ 467us) server_negotiation.cc:407] Connection header received
0807 06:58:33.851364 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:33.851368 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:33.851446 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:33.851529 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:33.852972 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.853785 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.855085 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.855478 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.855587 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.857971 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:33.857976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:33.857979 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:33.858010 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:33.860441 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:33.861051 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:33.861055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:33.861057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:33.861231 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:33.861599 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:33.861602 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:33.861604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:33.861898 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:33.862070 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:33.862346 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 06:58:33.862513 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 06:58:33.866709 30966 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:58:33.874082 30966 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:58:33.912076 31652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.887646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:40975 (local address 127.0.0.1:44198)
0807 06:58:33.900948 (+ 13302us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:33.900987 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:33.901811 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:33.902934 (+ 1123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:33.902951 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:33.903008 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:33.904026 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.904039 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.906750 (+ 2711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.906757 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.909190 (+ 2433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.909207 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.910996 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.911002 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.911207 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.911257 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 06:58:33.911415 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 06:58:33.911617 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13055,"mutex_wait_us":469,"spinlock_wait_cycles":3456,"thread_start_us":14335,"threads_started":1}
I20260807 06:58:33.912323 31661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.902856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56248 (local address 127.10.191.129:45905)
0807 06:58:33.903882 (+ 1026us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:33.903892 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:33.904521 (+ 629us) server_negotiation.cc:407] Connection header received
0807 06:58:33.905134 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:33.905142 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:33.905366 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:33.905571 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:33.906168 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.907775 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.909953 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.910972 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.911183 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.911355 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:33.911862 (+ 507us) server_negotiation.cc:299] Negotiation successful
0807 06:58:33.912003 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":809,"thread_start_us":638,"threads_started":1}
I20260807 06:58:33.912310 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.888009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44198 (local address 127.10.191.131:40975)
0807 06:58:33.901707 (+ 13698us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:33.901714 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:33.901751 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:58:33.902071 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:33.902081 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:33.902349 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:33.902555 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:33.904971 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.906605 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.909405 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.910778 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.910987 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.911200 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:33.911759 (+ 559us) server_negotiation.cc:299] Negotiation successful
0807 06:58:33.911945 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13530,"thread_start_us":13368,"threads_started":1}
I20260807 06:58:33.912902 31657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.902409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:56248)
0807 06:58:33.904395 (+ 1986us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:33.904412 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:33.904907 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:33.905567 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:33.905572 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:33.905596 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:33.905957 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.905973 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.907925 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.907931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.909803 (+ 1872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.909815 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.911522 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.911528 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.911675 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.911705 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 06:58:33.911809 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 06:58:33.911924 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1852,"thread_start_us":1690,"threads_started":1}
I20260807 06:58:33.913585 31654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.888496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44356 (local address 127.10.191.130:46749)
0807 06:58:33.901551 (+ 13055us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:33.901571 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:33.901952 (+ 381us) server_negotiation.cc:407] Connection header received
0807 06:58:33.902152 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:33.902158 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:33.902394 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:33.902602 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:33.904309 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.906300 (+ 1991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.909277 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.910778 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.911498 (+ 720us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.911666 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:33.913036 (+ 1370us) server_negotiation.cc:299] Negotiation successful
0807 06:58:33.913241 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12868,"thread_start_us":13048,"threads_started":1}
I20260807 06:58:33.916524 31649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:33.888261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:46749 (local address 127.0.0.1:44356)
0807 06:58:33.901811 (+ 13550us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:33.901829 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:33.901963 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:33.902936 (+ 973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:33.902943 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:33.902988 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:33.903580 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.903594 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.906451 (+ 2857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.906457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.909127 (+ 2670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:33.909140 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:33.912381 (+ 3241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:33.912386 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:33.912540 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:33.912585 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 06:58:33.912694 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 06:58:33.912816 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13420,"mutex_wait_us":25,"spinlock_wait_cycles":5376,"thread_start_us":12270,"threads_started":1}
I20260807 06:58:33.916409 31539 tablet_service.cc:1467] Processing CreateTablet for tablet 316e59f2bfe7448fbfd8c003fe4b23ea (DEFAULT_TABLE table=test-table [id=7795f1998d394af0aa528bf7e97026e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:33.916409 31136 tablet_service.cc:1467] Processing CreateTablet for tablet 316e59f2bfe7448fbfd8c003fe4b23ea (DEFAULT_TABLE table=test-table [id=7795f1998d394af0aa528bf7e97026e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:33.918074 31539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 316e59f2bfe7448fbfd8c003fe4b23ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:33.918087 31136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 316e59f2bfe7448fbfd8c003fe4b23ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:33.920202 31330 tablet_service.cc:1467] Processing CreateTablet for tablet 316e59f2bfe7448fbfd8c003fe4b23ea (DEFAULT_TABLE table=test-table [id=7795f1998d394af0aa528bf7e97026e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:33.921505 31330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 316e59f2bfe7448fbfd8c003fe4b23ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:33.929605 31662 tablet_bootstrap.cc:492] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: Bootstrap starting.
I20260807 06:58:33.932240 31663 tablet_bootstrap.cc:492] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: Bootstrap starting.
I20260807 06:58:33.932977 31662 tablet_bootstrap.cc:654] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:33.934307 31662 log.cc:824] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:33.935952 31663 tablet_bootstrap.cc:654] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:33.935081 31664 tablet_bootstrap.cc:492] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: Bootstrap starting.
I20260807 06:58:33.937028 31663 log.cc:824] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:33.938423 31662 tablet_bootstrap.cc:492] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: No bootstrap required, opened a new log
I20260807 06:58:33.938711 31662 ts_tablet_manager.cc:1397] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260807 06:58:33.939376 31664 tablet_bootstrap.cc:654] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:33.940145 31663 tablet_bootstrap.cc:492] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: No bootstrap required, opened a new log
I20260807 06:58:33.940378 31664 log.cc:824] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:33.940438 31663 ts_tablet_manager.cc:1397] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 06:58:33.943029 31664 tablet_bootstrap.cc:492] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: No bootstrap required, opened a new log
I20260807 06:58:33.943290 31664 ts_tablet_manager.cc:1397] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260807 06:58:33.949353 31662 raft_consensus.cc:348] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } }
I20260807 06:58:33.949766 31662 raft_consensus.cc:374] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:33.949862 31662 raft_consensus.cc:729] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c523efa47a524c7e98df15899567bf66, State: Initialized, Role: FOLLOWER
I20260807 06:58:33.950475 31662 consensus_queue.cc:260] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } }
I20260807 06:58:33.950662 31663 raft_consensus.cc:348] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } }
I20260807 06:58:33.951128 31663 raft_consensus.cc:374] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:33.951259 31663 raft_consensus.cc:729] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72fb83b7bd54cacb4e8baed68422cf9, State: Initialized, Role: FOLLOWER
I20260807 06:58:33.951840 31664 raft_consensus.cc:348] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } }
I20260807 06:58:33.952153 31664 raft_consensus.cc:374] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:33.952311 31664 raft_consensus.cc:729] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64921d1557d544b6837dce8342ecf3de, State: Initialized, Role: FOLLOWER
I20260807 06:58:33.952410 31662 ts_tablet_manager.cc:1428] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260807 06:58:33.952863 31664 consensus_queue.cc:260] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } }
I20260807 06:58:33.953023 31663 consensus_queue.cc:260] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } }
I20260807 06:58:33.958142 31633 heartbeater.cc:503] Master 127.10.191.190:35999 was elected leader, sending a full tablet report...
I20260807 06:58:33.959017 31663 ts_tablet_manager.cc:1428] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: Time spent starting tablet: real 0.018s user 0.017s sys 0.000s
I20260807 06:58:33.959800 31437 heartbeater.cc:503] Master 127.10.191.190:35999 was elected leader, sending a full tablet report...
I20260807 06:58:33.960379 31664 ts_tablet_manager.cc:1428] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: Time spent starting tablet: real 0.017s user 0.010s sys 0.008s
W20260807 06:58:34.019801 31231 tablet.cc:2369] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:58:34.044559 31440 tablet.cc:2369] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:58:34.063234 31634 tablet.cc:2369] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:58:34.064258 31672 raft_consensus.cc:482] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:58:34.064495 31672 raft_consensus.cc:504] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } }
I20260807 06:58:34.066056 31672 leader_election.cc:288] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64921d1557d544b6837dce8342ecf3de (127.10.191.130:46749), c523efa47a524c7e98df15899567bf66 (127.10.191.129:45905)
I20260807 06:58:34.072455 31636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:34.066349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:46749 (local address 127.10.191.131:59061)
0807 06:58:34.066678 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:34.066702 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:34.066848 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:34.067257 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:34.067260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:34.067290 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:34.067519 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:34.067530 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.068819 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.068825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:34.070324 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:34.070336 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.071655 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.071661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:34.071850 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:34.071887 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 06:58:34.071986 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 06:58:34.072120 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174}
I20260807 06:58:34.072495 31654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:34.066531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:59061 (local address 127.10.191.130:46749)
0807 06:58:34.066734 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:34.066739 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:34.066760 (+ 21us) server_negotiation.cc:407] Connection header received
0807 06:58:34.067027 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:34.067033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:34.067118 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:34.067220 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:34.067680 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.068687 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.070485 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.071503 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.071628 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:34.071680 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:34.072027 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 06:58:34.072206 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 06:58:34.073299 31661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:34.066587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:50561 (local address 127.10.191.129:45905)
0807 06:58:34.066762 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:34.066767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:34.067353 (+ 586us) server_negotiation.cc:407] Connection header received
0807 06:58:34.067519 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:34.067524 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:34.067607 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:34.067698 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:34.068295 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.069294 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.071138 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.072223 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.072429 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:34.072527 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:34.072873 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 06:58:34.072992 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:58:34.073436 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:34.066435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.10.191.131:50561)
0807 06:58:34.067238 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:34.067257 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:34.067393 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:34.067715 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:34.067719 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:34.067770 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:34.068134 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:34.068146 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.069440 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.069443 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:34.070977 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:34.070990 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.072493 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.072499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:34.072701 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:34.072731 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 06:58:34.072830 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 06:58:34.072956 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":469,"threads_started":1}
I20260807 06:58:34.073400 31371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "316e59f2bfe7448fbfd8c003fe4b23ea" candidate_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64921d1557d544b6837dce8342ecf3de" is_pre_election: true
I20260807 06:58:34.073995 31371 raft_consensus.cc:2454] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d72fb83b7bd54cacb4e8baed68422cf9 in term 0.
I20260807 06:58:34.074571 31165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "316e59f2bfe7448fbfd8c003fe4b23ea" candidate_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c523efa47a524c7e98df15899567bf66" is_pre_election: true
I20260807 06:58:34.074793 31475 leader_election.cc:302] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64921d1557d544b6837dce8342ecf3de, d72fb83b7bd54cacb4e8baed68422cf9; no voters:
I20260807 06:58:34.075176 31672 raft_consensus.cc:2781] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:58:34.075124 31165 raft_consensus.cc:2454] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d72fb83b7bd54cacb4e8baed68422cf9 in term 0.
I20260807 06:58:34.075296 31672 raft_consensus.cc:482] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:58:34.075423 31672 raft_consensus.cc:3037] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:34.077971 31672 raft_consensus.cc:504] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } }
I20260807 06:58:34.078539 31672 leader_election.cc:288] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [CANDIDATE]: Term 1 election: Requested vote from peers 64921d1557d544b6837dce8342ecf3de (127.10.191.130:46749), c523efa47a524c7e98df15899567bf66 (127.10.191.129:45905)
I20260807 06:58:34.078979 31371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "316e59f2bfe7448fbfd8c003fe4b23ea" candidate_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64921d1557d544b6837dce8342ecf3de"
I20260807 06:58:34.079012 31165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "316e59f2bfe7448fbfd8c003fe4b23ea" candidate_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c523efa47a524c7e98df15899567bf66"
I20260807 06:58:34.079159 31371 raft_consensus.cc:3037] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:34.079211 31165 raft_consensus.cc:3037] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:34.081482 31371 raft_consensus.cc:2454] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d72fb83b7bd54cacb4e8baed68422cf9 in term 1.
I20260807 06:58:34.081501 31165 raft_consensus.cc:2454] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d72fb83b7bd54cacb4e8baed68422cf9 in term 1.
I20260807 06:58:34.081899 31472 leader_election.cc:302] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c523efa47a524c7e98df15899567bf66, d72fb83b7bd54cacb4e8baed68422cf9; no voters:
I20260807 06:58:34.082238 31672 raft_consensus.cc:2781] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:58:34.082675 31672 raft_consensus.cc:686] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 LEADER]: Becoming Leader. State: Replica: d72fb83b7bd54cacb4e8baed68422cf9, State: Running, Role: LEADER
I20260807 06:58:34.083106 31672 consensus_queue.cc:237] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } }
I20260807 06:58:34.087334 30966 catalog_manager.cc:5495] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d72fb83b7bd54cacb4e8baed68422cf9 (127.10.191.131). New cstate: current_term: 1 leader_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260807 06:58:34.107861 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:34.102164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44208 (local address 127.10.191.131:40975)
0807 06:58:34.102378 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:34.102384 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:34.102491 (+ 107us) server_negotiation.cc:407] Connection header received
0807 06:58:34.102744 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:34.102748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:34.102830 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:34.102973 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:58:34.103349 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.104176 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.105729 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.106116 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.106267 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:34.106814 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:58:34.107290 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:58:34.107444 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:34.107504 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 06:58:34.107578 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:58:34.115923 31371 raft_consensus.cc:1261] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [term 1 FOLLOWER]: Refusing update from remote peer d72fb83b7bd54cacb4e8baed68422cf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:34.115953 31165 raft_consensus.cc:1261] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [term 1 FOLLOWER]: Refusing update from remote peer d72fb83b7bd54cacb4e8baed68422cf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:34.116938 31678 consensus_queue.cc:1035] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:34.117323 31672 consensus_queue.cc:1035] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:34.129702 31682 mvcc.cc:205] Tried to move back new op lower bound from 7315807904208416768 to 7315807904087662592. Current Snapshot: MvccSnapshot[applied={T|T < 7315807904208416768}]
I20260807 06:58:34.130259 31683 mvcc.cc:205] Tried to move back new op lower bound from 7315807904208416768 to 7315807904087662592. Current Snapshot: MvccSnapshot[applied={T|T < 7315807904208416768}]
I20260807 06:58:34.162750 30967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:58:34.163064 30967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:58:34.167263 30967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Sending DeleteTablet for 3 replicas of tablet 316e59f2bfe7448fbfd8c003fe4b23ea
I20260807 06:58:34.168504 31539 tablet_service.cc:1514] Processing DeleteTablet for tablet 316e59f2bfe7448fbfd8c003fe4b23ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:34 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:44198
I20260807 06:58:34.168747 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 31053
I20260807 06:58:34.168673 31330 tablet_service.cc:1514] Processing DeleteTablet for tablet 316e59f2bfe7448fbfd8c003fe4b23ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:34 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:44356
I20260807 06:58:34.169374 31136 tablet_service.cc:1514] Processing DeleteTablet for tablet 316e59f2bfe7448fbfd8c003fe4b23ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:34 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:56248
I20260807 06:58:34.170171 31698 tablet_replica.cc:330] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: stopping tablet replica
I20260807 06:58:34.170631 31698 raft_consensus.cc:2229] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:58:34.171175 31698 raft_consensus.cc:2258] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:34.173475 31698 ts_tablet_manager.cc:1905] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:34.182273 31698 ts_tablet_manager.cc:1918] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:34.182510 31698 log.cc:1196] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/316e59f2bfe7448fbfd8c003fe4b23ea
I20260807 06:58:34.183152 31698 ts_tablet_manager.cc:1939] T 316e59f2bfe7448fbfd8c003fe4b23ea P c523efa47a524c7e98df15899567bf66: Deleting consensus metadata
I20260807 06:58:34.184763 31695 tablet_replica.cc:330] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: stopping tablet replica
I20260807 06:58:34.185214 30943 catalog_manager.cc:4841] TS c523efa47a524c7e98df15899567bf66 (127.10.191.129:45905): tablet 316e59f2bfe7448fbfd8c003fe4b23ea (table test-table [id=7795f1998d394af0aa528bf7e97026e4]) successfully deleted
I20260807 06:58:34.185271 31695 raft_consensus.cc:2229] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:58:34.186008 31695 raft_consensus.cc:2258] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:34.186426 31697 tablet_replica.cc:330] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: stopping tablet replica
I20260807 06:58:34.186879 31697 raft_consensus.cc:2229] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:58:34.187364 31697 raft_consensus.cc:2258] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:34.188019 31695 ts_tablet_manager.cc:1905] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:34.189379 31697 ts_tablet_manager.cc:1905] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:34.195739 31695 ts_tablet_manager.cc:1918] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:34.195960 31695 log.cc:1196] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/316e59f2bfe7448fbfd8c003fe4b23ea
I20260807 06:58:34.196156 31697 ts_tablet_manager.cc:1918] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:34.196334 31697 log.cc:1196] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/316e59f2bfe7448fbfd8c003fe4b23ea
I20260807 06:58:34.196622 31695 ts_tablet_manager.cc:1939] T 316e59f2bfe7448fbfd8c003fe4b23ea P d72fb83b7bd54cacb4e8baed68422cf9: Deleting consensus metadata
I20260807 06:58:34.196914 31697 ts_tablet_manager.cc:1939] T 316e59f2bfe7448fbfd8c003fe4b23ea P 64921d1557d544b6837dce8342ecf3de: Deleting consensus metadata
Aug 07 06:58:34 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:58:34.198746 30949 catalog_manager.cc:4841] TS 64921d1557d544b6837dce8342ecf3de (127.10.191.130:46749): tablet 316e59f2bfe7448fbfd8c003fe4b23ea (table test-table [id=7795f1998d394af0aa528bf7e97026e4]) successfully deleted
I20260807 06:58:34.198864 30943 catalog_manager.cc:4841] TS d72fb83b7bd54cacb4e8baed68422cf9 (127.10.191.131:40975): tablet 316e59f2bfe7448fbfd8c003fe4b23ea (table test-table [id=7795f1998d394af0aa528bf7e97026e4]) successfully deleted
I20260807 06:58:34.206007 31661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:34.170476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56260 (local address 127.10.191.129:45905)
0807 06:58:34.170648 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:34.170656 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:34.185756 (+ 15100us) server_negotiation.cc:407] Connection header received
0807 06:58:34.185978 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:34.185986 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:34.186087 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:34.186207 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:34.188643 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.189858 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.192053 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.192739 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.192853 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:34.199591 (+ 6738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:34.199605 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:34.199618 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:34.199652 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:34.202780 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:34.203526 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:34.203534 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:34.203536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:34.203750 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:34.204216 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:34.204222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:34.204225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:34.204727 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:34.205082 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:34.205413 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 06:58:34.205639 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:58:34.206734 31219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:34.295910 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 31053
I20260807 06:58:34.322953 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 31238
Aug 07 06:58:34 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:58:34.348101 31654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:34.323767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44370 (local address 127.10.191.130:46749)
0807 06:58:34.323965 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:34.323972 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:34.324079 (+ 107us) server_negotiation.cc:407] Connection header received
0807 06:58:34.324286 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:34.324295 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:34.324357 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:34.324474 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:34.325889 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.326602 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.327898 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.328282 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.328420 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:34.336495 (+ 8075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:34.336506 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:34.336519 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:34.336549 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:34.344103 (+ 7554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:34.344969 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:34.344980 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:34.344985 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:34.345163 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:34.345570 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:34.345576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:34.345581 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:34.346046 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:34.346302 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:34.347424 (+ 1122us) server_negotiation.cc:299] Negotiation successful
0807 06:58:34.347681 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 06:58:34.348851 31430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:34.438858 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 31238
I20260807 06:58:34.463516 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 31447
Aug 07 06:58:34 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:58:34.482435 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:34.464486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44218 (local address 127.10.191.131:40975)
0807 06:58:34.464642 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:34.464646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:34.464866 (+ 220us) server_negotiation.cc:407] Connection header received
0807 06:58:34.465036 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:34.465042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:34.465183 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:34.465300 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:34.466670 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.467895 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.469412 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:34.470126 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:34.470251 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:34.474967 (+ 4716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:34.474988 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:34.475009 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:34.475066 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:34.479420 (+ 4354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:34.480154 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:34.480163 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:34.480167 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:34.480366 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:34.480745 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:34.480750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:34.480753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:34.481214 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:34.481588 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:34.481774 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 06:58:34.482008 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:58:34.483314 31627 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:34.600826 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 31447
I20260807 06:58:34.628911 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 30923
I20260807 06:58:34.630110 31008 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:34.737337 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 30923
I20260807 06:58:34.768893 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35999
--webserver_interface=127.10.191.190
--webserver_port=40883
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:35999
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:35.099156 31706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:35.099427 31706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:35.099516 31706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:35.106494 31706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:35.106627 31706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:35.106706 31706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:35.106792 31706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:35.106856 31706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:35.115890 31706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:35999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=40883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:35.117193 31706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:35.118492 31706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:35.144820 31718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:35.144917 31715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:35.144850 31714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:35.149452 31706 server_base.cc:1034] running on GCE node
I20260807 06:58:35.150278 31706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:35.151778 31706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:35.153007 31706 hybrid_clock.cc:648] HybridClock initialized: now 1786085915152961 us; error 55 us; skew 500 ppm
I20260807 06:58:35.153390 31706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:35 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085915, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:35.160789 31706 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:58:35.162544 31706 webserver.cc:460] Webserver started at http://127.10.191.190:40883/ using document root <none> and password file <none>
I20260807 06:58:35.163364 31706 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:35.163529 31706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:35.169503 31706 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 06:58:35.172323 31727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:35.173636 31706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:58:35.173830 31706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "0e7fab30fcc56e06a0fb8d2871e8ea4f"
server_key_iv: "614980ac7f096e53b42c264099029e3f"
server_key_version: "encryptionkey@0"
I20260807 06:58:35.174891 31706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:35.219369 31706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:35.223987 31706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:35.224303 31706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:35.243109 31706 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:35999
I20260807 06:58:35.243130 31793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:35999 every 8 connection(s)
I20260807 06:58:35.244586 31706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:58:35.247737 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 31706
I20260807 06:58:35.248667 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:45905
--local_ip_for_outbound_sockets=127.10.191.129
--tserver_master_addrs=127.10.191.190:35999
--webserver_port=43177
--webserver_interface=127.10.191.129
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:58:35.251794 31794 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:58:35.255085 31794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Bootstrap starting.
I20260807 06:58:35.274380 31794 log.cc:824] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:35.286914 31794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:58:35.287439 31794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Bootstrap complete.
I20260807 06:58:35.296967 31794 raft_consensus.cc:348] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:35.297948 31794 raft_consensus.cc:729] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82b7878d3ba46d7b0bcb2fc8bba4f34, State: Initialized, Role: FOLLOWER
I20260807 06:58:35.298552 31794 consensus_queue.cc:260] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:35.298835 31794 raft_consensus.cc:388] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:58:35.298978 31794 raft_consensus.cc:482] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:58:35.299181 31794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:58:35.303049 31794 raft_consensus.cc:504] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:35.303592 31794 leader_election.cc:302] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b82b7878d3ba46d7b0bcb2fc8bba4f34; no voters:
I20260807 06:58:35.304329 31794 leader_election.cc:288] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:58:35.304479 31798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:58:35.305991 31798 raft_consensus.cc:686] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 2 LEADER]: Becoming Leader. State: Replica: b82b7878d3ba46d7b0bcb2fc8bba4f34, State: Running, Role: LEADER
I20260807 06:58:35.306499 31798 consensus_queue.cc:237] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:35.306826 31794 sys_catalog.cc:564] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:58:35.309259 31800 sys_catalog.cc:455] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b82b7878d3ba46d7b0bcb2fc8bba4f34. Latest consensus state: current_term: 2 leader_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } } }
I20260807 06:58:35.309620 31800 sys_catalog.cc:458] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:35.310130 31799 sys_catalog.cc:455] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } } }
I20260807 06:58:35.310410 31799 sys_catalog.cc:458] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:35.320209 31806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:58:35.328451 31806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:58:35.329867 31806 catalog_manager.cc:1259] Loaded cluster ID: b22b46e1542b4204a82efb03999e9f31
I20260807 06:58:35.330039 31806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:58:35.333457 31806 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 06:58:35.351717 31806 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 06:58:35.368273 31806 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:58:35.369726 31806 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Loaded TSK: 0
I20260807 06:58:35.370795 31806 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:58:35.626667 31796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:35.626947 31796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:35.627099 31796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:35.633733 31796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:35.633862 31796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:35.634030 31796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:58:35.643033 31796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:45905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=43177
--tserver_master_addrs=127.10.191.190:35999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:35.644227 31796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:35.645641 31796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:35.660110 31831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:35.660087 31830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:35.660766 31833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:35.661617 31796 server_base.cc:1034] running on GCE node
I20260807 06:58:35.662271 31796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:35.663471 31796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:35.664690 31796 hybrid_clock.cc:648] HybridClock initialized: now 1786085915664635 us; error 46 us; skew 500 ppm
I20260807 06:58:35.665011 31796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:35 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085915, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:35.668251 31796 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:58:35.669832 31796 webserver.cc:460] Webserver started at http://127.10.191.129:43177/ using document root <none> and password file <none>
I20260807 06:58:35.670477 31796 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:35.670614 31796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:35.675755 31796 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:58:35.678952 31841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:35.680352 31796 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:35.680503 31796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "c523efa47a524c7e98df15899567bf66"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "4538d9c887889b2b636dd695aebd0f74"
server_key_iv: "f1dc843bd0738b6e22f9fd832ff130ec"
server_key_version: "encryptionkey@0"
I20260807 06:58:35.681515 31796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:35.699034 31796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:35.702906 31796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:35.703168 31796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:35.704171 31796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:35.705502 31796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:35.705616 31796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:35.705732 31796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:35.705834 31796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:35.739449 31796 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:45905
I20260807 06:58:35.739468 32009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:45905 every 8 connection(s)
I20260807 06:58:35.740878 31796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:58:35.748335 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 31796
I20260807 06:58:35.749123 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:46749
--local_ip_for_outbound_sockets=127.10.191.130
--tserver_master_addrs=127.10.191.190:35999
--webserver_port=35169
--webserver_interface=127.10.191.130
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:58:35 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085915, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:35.763022 32012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:35.743629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:46681 (local address 127.10.191.190:35999)
0807 06:58:35.744216 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:35.744250 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:35.744864 (+ 614us) server_negotiation.cc:407] Connection header received
0807 06:58:35.746897 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:35.746908 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:35.747181 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:35.747536 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:35.749152 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:35.750407 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:35.751974 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:35.752609 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:35.752808 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:35.756125 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:35.756132 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:35.756143 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:35.756176 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:35.759011 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:35.759701 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:35.759714 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:35.759719 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:35.759883 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:35.760285 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:35.760290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:35.760293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:35.760689 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:35.760883 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:35.761623 (+ 740us) server_negotiation.cc:299] Negotiation successful
0807 06:58:35.761960 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":257,"threads_started":1}
I20260807 06:58:35.763031 32014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:35.743900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:46681)
0807 06:58:35.744715 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:35.744749 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:35.746410 (+ 1661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:35.747646 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:35.747654 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:35.748290 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:35.748896 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:35.748915 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:35.750566 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:35.750572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:35.751796 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:35.751815 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:35.752836 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:35.752844 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:35.753209 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:35.753827 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:35.753847 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:35.755864 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:35.759162 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:35.759170 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:35.759182 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:35.759570 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:35.759998 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:35.760002 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:35.760005 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:35.760177 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:35.760819 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:35.760828 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:35.761182 (+ 354us) client_negotiation.cc:769] Sending connection context
0807 06:58:35.761417 (+ 235us) client_negotiation.cc:240] Negotiation successful
0807 06:58:35.761863 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":327,"threads_started":1}
I20260807 06:58:35.765867 32010 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35999
I20260807 06:58:35.766179 32010 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:35.766875 32010 heartbeater.cc:511] Master 127.10.191.190:35999 requested a full tablet report, sending...
I20260807 06:58:35.769229 31749 ts_manager.cc:194] Registered new tserver with Master: c523efa47a524c7e98df15899567bf66 (127.10.191.129:45905)
I20260807 06:58:35.771461 31749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:46681
W20260807 06:58:36.088089 32015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:36.088358 32015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:36.088454 32015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:36.095129 32015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:36.095253 32015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:36.095355 32015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:58:36.104569 32015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:46749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=35169
--tserver_master_addrs=127.10.191.190:35999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:36.105631 32015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:36.106897 32015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:36.119836 32029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:36.119796 32031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:36.119882 32033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:36.120810 32015 server_base.cc:1034] running on GCE node
I20260807 06:58:36.121464 32015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:36.122475 32015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:36.123688 32015 hybrid_clock.cc:648] HybridClock initialized: now 1786085916123645 us; error 61 us; skew 500 ppm
I20260807 06:58:36.123962 32015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:36 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085916, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:36.127070 32015 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:58:36.128492 32015 webserver.cc:460] Webserver started at http://127.10.191.130:35169/ using document root <none> and password file <none>
I20260807 06:58:36.129232 32015 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:36.129387 32015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:36.134526 32015 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:58:36.137041 32041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:36.138351 32015 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:58:36.138535 32015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "64921d1557d544b6837dce8342ecf3de"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "2b0e2e920da4a1d601db255dd48bc259"
server_key_iv: "1b28399fe77667750d7c02235df79869"
server_key_version: "encryptionkey@0"
I20260807 06:58:36.139497 32015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:36.166020 32015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:36.170292 32015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:36.170559 32015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:36.171644 32015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:36.172955 32015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:36.173110 32015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:36.173230 32015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:36.173346 32015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:36.206105 32015 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:46749
I20260807 06:58:36.206197 32202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:46749 every 8 connection(s)
I20260807 06:58:36.207515 32015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:58:36.211408 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 32015
I20260807 06:58:36.212224 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:40975
--local_ip_for_outbound_sockets=127.10.191.131
--tserver_master_addrs=127.10.191.190:35999
--webserver_port=44387
--webserver_interface=127.10.191.131
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:58:36 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085916, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:36.230598 32012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.210090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:52997 (local address 127.10.191.190:35999)
0807 06:58:36.210293 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.210297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.211607 (+ 1310us) server_negotiation.cc:407] Connection header received
0807 06:58:36.214614 (+ 3007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.214618 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.214692 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.214780 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:36.216887 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.217635 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.220224 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.220623 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.220721 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.224820 (+ 4099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:36.224824 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:36.224827 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:36.224858 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:36.227440 (+ 2582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:36.228212 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:36.228219 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:36.228222 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:36.228373 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:36.228812 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:36.228817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:36.228820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:36.229168 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:36.229322 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.229991 (+ 669us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.230248 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 06:58:36.231596 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.210622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:52997)
0807 06:58:36.211440 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:36.211489 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:36.214267 (+ 2778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:36.215065 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:36.215080 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:36.215878 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:36.216660 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.216710 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.217805 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.217814 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.219973 (+ 2159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.219991 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.220860 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.220870 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.221276 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.222015 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:36.222050 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:36.224628 (+ 2578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:36.227592 (+ 2964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:36.227601 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:36.227616 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:36.228056 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:36.228492 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:36.228497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:36.228501 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:36.228694 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:36.229304 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:36.229311 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:36.229631 (+ 320us) client_negotiation.cc:769] Sending connection context
0807 06:58:36.229893 (+ 262us) client_negotiation.cc:240] Negotiation successful
0807 06:58:36.230423 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":305,"threads_started":1}
I20260807 06:58:36.233165 32204 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35999
I20260807 06:58:36.233454 32204 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:36.234181 32204 heartbeater.cc:511] Master 127.10.191.190:35999 requested a full tablet report, sending...
I20260807 06:58:36.235570 31749 ts_manager.cc:194] Registered new tserver with Master: 64921d1557d544b6837dce8342ecf3de (127.10.191.130:46749)
I20260807 06:58:36.236320 31749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:52997
W20260807 06:58:36.556442 32207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:36.556694 32207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:36.556799 32207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:36.563313 32207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:36.563405 32207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:36.563506 32207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:58:36.572763 32207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:40975
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=44387
--tserver_master_addrs=127.10.191.190:35999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:36.573840 32207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:36.575044 32207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:36.587427 32225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:36.587489 32222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:36.587460 32220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:36.587930 32207 server_base.cc:1034] running on GCE node
I20260807 06:58:36.588649 32207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:36.589581 32207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:36.590775 32207 hybrid_clock.cc:648] HybridClock initialized: now 1786085916590734 us; error 32 us; skew 500 ppm
I20260807 06:58:36.591112 32207 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:36 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085916, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:36.594003 32207 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:58:36.595222 32207 webserver.cc:460] Webserver started at http://127.10.191.131:44387/ using document root <none> and password file <none>
I20260807 06:58:36.595800 32207 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:36.595974 32207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:36.600816 32207 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:58:36.603523 32233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:36.604795 32207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:36.604960 32207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "d72fb83b7bd54cacb4e8baed68422cf9"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "32a79dff62ecaae66efba1963bd8ddc1"
server_key_iv: "30a92d7921ac8f7dff10ca6510054561"
server_key_version: "encryptionkey@0"
I20260807 06:58:36.605997 32207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:36.649752 32207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:36.653679 32207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:36.653941 32207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:36.654879 32207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:36.656085 32207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:36.656174 32207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:36.656252 32207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:36.656301 32207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:36.688242 32207 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:40975
I20260807 06:58:36.688330 32397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:40975 every 8 connection(s)
I20260807 06:58:36.689684 32207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:58:36.694693 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 32207
Aug 07 06:58:36 dist-test-slave-tfpf krb5kdc[30906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085916, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:36.708331 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.695579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56122 (local address 127.10.191.190:35999)
0807 06:58:36.696431 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.696434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.696448 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:58:36.696481 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.696484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.696523 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.696626 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:36.698199 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.698926 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.700203 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.700568 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.700700 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.703144 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:36.703148 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:36.703151 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:36.703184 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:36.705667 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:36.706296 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:36.706301 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:36.706304 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:36.706444 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:36.706786 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:36.706790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:36.706793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:36.707113 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:36.707361 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.707648 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.707860 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":679,"threads_started":1}
I20260807 06:58:36.708443 32012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.692032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:51867 (local address 127.10.191.190:35999)
0807 06:58:36.692194 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.692197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.693251 (+ 1054us) server_negotiation.cc:407] Connection header received
0807 06:58:36.694835 (+ 1584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.694840 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.694921 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.695020 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:36.696784 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.697565 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.699077 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.699529 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.699658 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.702690 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:36.702694 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:36.702697 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:36.702723 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:36.705558 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:36.706222 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:36.706231 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:36.706233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:36.706352 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:36.706725 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:36.706731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:36.706733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:36.706970 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:36.707164 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.707720 (+ 556us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.708023 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":52}
I20260807 06:58:36.709519 32404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.692438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:51867)
0807 06:58:36.693116 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:36.693158 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:36.694598 (+ 1440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:36.695234 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:36.695240 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:36.695930 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:36.696597 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.696612 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.697718 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.697724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.698921 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.698933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.699749 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.699755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.699948 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.700533 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:36.700553 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:36.702510 (+ 1957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:36.705683 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:36.705691 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:36.705702 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:36.706106 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:36.706458 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:36.706462 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:36.706465 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:36.706622 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:36.707125 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:36.707132 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:36.707409 (+ 277us) client_negotiation.cc:769] Sending connection context
0807 06:58:36.707639 (+ 230us) client_negotiation.cc:240] Negotiation successful
0807 06:58:36.708117 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":239,"threads_started":1}
I20260807 06:58:36.710817 32400 heartbeater.cc:347] Connected to a master server at 127.10.191.190:35999
I20260807 06:58:36.711105 32400 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:36.711853 32400 heartbeater.cc:511] Master 127.10.191.190:35999 requested a full tablet report, sending...
I20260807 06:58:36.713191 31749 ts_manager.cc:194] Registered new tserver with Master: d72fb83b7bd54cacb4e8baed68422cf9 (127.10.191.131:40975)
I20260807 06:58:36.713912 31749 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:51867
I20260807 06:58:36.723291 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:58:36.729923 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.724201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56130 (local address 127.10.191.190:35999)
0807 06:58:36.724369 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.724377 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.724826 (+ 449us) server_negotiation.cc:407] Connection header received
0807 06:58:36.724992 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.724995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.725180 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.725296 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:58:36.725714 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.726418 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.727789 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.728217 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.728306 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.728759 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:58:36.729263 (+ 504us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:58:36.729392 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.729547 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.729616 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:58:36.730752 31749 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:56130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:58:36.737614 31749 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:58:36.758831 32422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.750319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47508 (local address 127.10.191.130:46749)
0807 06:58:36.751518 (+ 1199us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.751523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.751543 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:58:36.751611 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.751616 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.751772 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.751947 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:36.752457 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.753550 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.756040 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.757554 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.757747 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.757933 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.758335 (+ 402us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.758505 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1084,"thread_start_us":979,"threads_started":1}
I20260807 06:58:36.758901 32421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.749769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:46749 (local address 127.0.0.1:47508)
0807 06:58:36.750719 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:36.750735 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:36.750831 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:36.751952 (+ 1121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:36.751957 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:36.751981 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:36.752298 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.752306 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.753688 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.753695 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.755883 (+ 2188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.755895 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.757802 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.757810 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.758047 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.758132 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 06:58:36.758269 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 06:58:36.758451 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"mutex_wait_us":2,"thread_start_us":3459,"threads_started":1}
I20260807 06:58:36.762070 32415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.749214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:40975 (local address 127.0.0.1:36166)
0807 06:58:36.749935 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:36.749973 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:36.750110 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:36.754578 (+ 4468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:36.754585 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:36.754617 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:36.755180 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.755195 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.757195 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.757200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.759542 (+ 2342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.759558 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.761243 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.761249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.761404 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.761432 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 06:58:36.761529 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 06:58:36.761662 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"mutex_wait_us":124,"thread_start_us":369,"threads_started":1}
I20260807 06:58:36.762089 32419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.749292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36166 (local address 127.10.191.131:40975)
0807 06:58:36.754068 (+ 4776us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.754074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.754102 (+ 28us) server_negotiation.cc:407] Connection header received
0807 06:58:36.754203 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.754209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.754395 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.754574 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:36.755385 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.757014 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.759688 (+ 2674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.760985 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.761201 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.761356 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.761587 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.761728 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4605,"thread_start_us":4840,"threads_started":1}
I20260807 06:58:36.762427 32420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.750256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:45048)
0807 06:58:36.753461 (+ 3205us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:36.753477 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:36.753665 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:36.754411 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:36.754417 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:36.754444 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:36.755002 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.755028 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.757195 (+ 2167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.757200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.759583 (+ 2383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.759595 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.761606 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.761611 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.761786 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.761817 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:58:36.761941 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 06:58:36.762075 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3108,"mutex_wait_us":172,"thread_start_us":689,"threads_started":1}
I20260807 06:58:36.762956 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.750786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45048 (local address 127.10.191.129:45905)
0807 06:58:36.751309 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.751319 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.753569 (+ 2250us) server_negotiation.cc:407] Connection header received
0807 06:58:36.753834 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.753841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.754042 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.754211 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:36.755257 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.756973 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.759756 (+ 2783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.761120 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.761308 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.761459 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.762619 (+ 1160us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.762750 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":286,"threads_started":1}
I20260807 06:58:36.763841 32106 tablet_service.cc:1467] Processing CreateTablet for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b (DEFAULT_TABLE table=test-table [id=8c23db17286f40f58dcd238fb62bf282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:36.765370 32106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:36.766218 32309 tablet_service.cc:1467] Processing CreateTablet for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b (DEFAULT_TABLE table=test-table [id=8c23db17286f40f58dcd238fb62bf282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:36.766594 31911 tablet_service.cc:1467] Processing CreateTablet for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b (DEFAULT_TABLE table=test-table [id=8c23db17286f40f58dcd238fb62bf282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:36.767639 32309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:36.767992 31911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:36.774430 32010 heartbeater.cc:503] Master 127.10.191.190:35999 was elected leader, sending a full tablet report...
I20260807 06:58:36.777347 32428 tablet_bootstrap.cc:492] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: Bootstrap starting.
I20260807 06:58:36.780678 32428 tablet_bootstrap.cc:654] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:36.781868 32428 log.cc:824] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:36.783267 32429 tablet_bootstrap.cc:492] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: Bootstrap starting.
I20260807 06:58:36.784811 32428 tablet_bootstrap.cc:492] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: No bootstrap required, opened a new log
I20260807 06:58:36.785054 32428 ts_tablet_manager.cc:1397] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260807 06:58:36.786453 32429 tablet_bootstrap.cc:654] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:36.787601 32429 log.cc:824] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:36.790128 32432 tablet_bootstrap.cc:492] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Bootstrap starting.
I20260807 06:58:36.790872 32429 tablet_bootstrap.cc:492] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: No bootstrap required, opened a new log
I20260807 06:58:36.791108 32429 ts_tablet_manager.cc:1397] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 06:58:36.792543 32432 tablet_bootstrap.cc:654] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:36.793537 32432 log.cc:824] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:36.795172 32428 raft_consensus.cc:348] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } }
I20260807 06:58:36.795643 32428 raft_consensus.cc:374] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:36.795744 32428 raft_consensus.cc:729] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64921d1557d544b6837dce8342ecf3de, State: Initialized, Role: FOLLOWER
I20260807 06:58:36.796387 32428 consensus_queue.cc:260] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } }
I20260807 06:58:36.797127 32432 tablet_bootstrap.cc:492] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: No bootstrap required, opened a new log
I20260807 06:58:36.797468 32432 ts_tablet_manager.cc:1397] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260807 06:58:36.797689 32204 heartbeater.cc:503] Master 127.10.191.190:35999 was elected leader, sending a full tablet report...
I20260807 06:58:36.799671 32428 ts_tablet_manager.cc:1428] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: Time spent starting tablet: real 0.015s user 0.012s sys 0.001s
I20260807 06:58:36.800765 32429 raft_consensus.cc:348] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } }
I20260807 06:58:36.801139 32429 raft_consensus.cc:374] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:36.801258 32429 raft_consensus.cc:729] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d72fb83b7bd54cacb4e8baed68422cf9, State: Initialized, Role: FOLLOWER
I20260807 06:58:36.801795 32429 consensus_queue.cc:260] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } }
I20260807 06:58:36.802809 32400 heartbeater.cc:503] Master 127.10.191.190:35999 was elected leader, sending a full tablet report...
I20260807 06:58:36.803366 32429 ts_tablet_manager.cc:1428] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260807 06:58:36.806586 32432 raft_consensus.cc:348] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } }
I20260807 06:58:36.807010 32432 raft_consensus.cc:374] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:36.807130 32432 raft_consensus.cc:729] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c523efa47a524c7e98df15899567bf66, State: Initialized, Role: FOLLOWER
I20260807 06:58:36.807672 32432 consensus_queue.cc:260] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } }
I20260807 06:58:36.809099 32432 ts_tablet_manager.cc:1428] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Time spent starting tablet: real 0.011s user 0.009s sys 0.002s
I20260807 06:58:36.854714 32438 raft_consensus.cc:482] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:58:36.854982 32438 raft_consensus.cc:504] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } }
I20260807 06:58:36.856562 32438 leader_election.cc:288] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c523efa47a524c7e98df15899567bf66 (127.10.191.129:45905), 64921d1557d544b6837dce8342ecf3de (127.10.191.130:46749)
I20260807 06:58:36.862785 32404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.856880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:46749 (local address 127.10.191.131:40113)
0807 06:58:36.857214 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:36.857236 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:36.857398 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:36.857764 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:36.857768 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:36.857791 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:36.857950 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.857957 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.859276 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.859282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.860668 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.860679 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.861979 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.861984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.862229 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.862267 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 06:58:36.862368 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 06:58:36.862501 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152}
I20260807 06:58:36.862823 32422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.857198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:40113 (local address 127.10.191.130:46749)
0807 06:58:36.857417 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.857425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.857449 (+ 24us) server_negotiation.cc:407] Connection header received
0807 06:58:36.857527 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.857533 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.857629 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.857743 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:36.858107 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.859111 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.860823 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.861849 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.861951 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.862002 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.862427 (+ 425us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.862545 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:58:36.863829 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.856881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:55375 (local address 127.10.191.129:45905)
0807 06:58:36.857108 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.857115 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.857921 (+ 806us) server_negotiation.cc:407] Connection header received
0807 06:58:36.858179 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.858183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.858240 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.858309 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:36.858901 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.859846 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.861636 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.862764 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.862936 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.863005 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.863442 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.863558 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 06:58:36.863896 32443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.856966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.10.191.131:55375)
0807 06:58:36.857826 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:36.857847 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:36.857973 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:36.858359 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:36.858364 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:36.858391 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:36.858734 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.858746 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.859984 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.859987 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.861492 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:36.861506 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.863086 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.863091 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:36.863271 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.863312 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 06:58:36.863410 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 06:58:36.863520 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":456,"threads_started":1}
I20260807 06:58:36.864156 32138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aa1e25bc8a140e6ac507c3d4c8cbc5b" candidate_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64921d1557d544b6837dce8342ecf3de" is_pre_election: true
I20260807 06:58:36.864681 32138 raft_consensus.cc:2454] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d72fb83b7bd54cacb4e8baed68422cf9 in term 0.
I20260807 06:58:36.864943 31938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aa1e25bc8a140e6ac507c3d4c8cbc5b" candidate_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c523efa47a524c7e98df15899567bf66" is_pre_election: true
I20260807 06:58:36.865454 32238 leader_election.cc:302] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64921d1557d544b6837dce8342ecf3de, d72fb83b7bd54cacb4e8baed68422cf9; no voters:
I20260807 06:58:36.865509 31938 raft_consensus.cc:2454] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d72fb83b7bd54cacb4e8baed68422cf9 in term 0.
I20260807 06:58:36.865835 32438 raft_consensus.cc:2781] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:58:36.865988 32438 raft_consensus.cc:482] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:58:36.866119 32438 raft_consensus.cc:3037] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:36.868319 32438 raft_consensus.cc:504] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } }
I20260807 06:58:36.868885 32438 leader_election.cc:288] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [CANDIDATE]: Term 1 election: Requested vote from peers c523efa47a524c7e98df15899567bf66 (127.10.191.129:45905), 64921d1557d544b6837dce8342ecf3de (127.10.191.130:46749)
I20260807 06:58:36.869338 32138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aa1e25bc8a140e6ac507c3d4c8cbc5b" candidate_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64921d1557d544b6837dce8342ecf3de"
I20260807 06:58:36.869411 31938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9aa1e25bc8a140e6ac507c3d4c8cbc5b" candidate_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c523efa47a524c7e98df15899567bf66"
I20260807 06:58:36.869519 32138 raft_consensus.cc:3037] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:36.869627 31938 raft_consensus.cc:3037] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:36.871886 32138 raft_consensus.cc:2454] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d72fb83b7bd54cacb4e8baed68422cf9 in term 1.
I20260807 06:58:36.872217 32238 leader_election.cc:302] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64921d1557d544b6837dce8342ecf3de, d72fb83b7bd54cacb4e8baed68422cf9; no voters:
I20260807 06:58:36.872511 32438 raft_consensus.cc:2781] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:58:36.872740 31938 raft_consensus.cc:2454] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d72fb83b7bd54cacb4e8baed68422cf9 in term 1.
I20260807 06:58:36.873041 32438 raft_consensus.cc:686] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 LEADER]: Becoming Leader. State: Replica: d72fb83b7bd54cacb4e8baed68422cf9, State: Running, Role: LEADER
I20260807 06:58:36.873612 32438 consensus_queue.cc:237] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } }
I20260807 06:58:36.877893 31749 catalog_manager.cc:5495] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d72fb83b7bd54cacb4e8baed68422cf9 (127.10.191.131). New cstate: current_term: 1 leader_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d72fb83b7bd54cacb4e8baed68422cf9" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 40975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260807 06:58:36.897267 32419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.892855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36176 (local address 127.10.191.131:40975)
0807 06:58:36.893017 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.893021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.893035 (+ 14us) server_negotiation.cc:407] Connection header received
0807 06:58:36.893210 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.893213 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.893282 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.893387 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:58:36.893679 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.894267 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.895486 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.895815 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.895895 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.896299 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:58:36.896699 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:58:36.896835 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.896921 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.896979 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 06:58:36.904660 31938 raft_consensus.cc:1261] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [term 1 FOLLOWER]: Refusing update from remote peer d72fb83b7bd54cacb4e8baed68422cf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:36.904654 32138 raft_consensus.cc:1261] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [term 1 FOLLOWER]: Refusing update from remote peer d72fb83b7bd54cacb4e8baed68422cf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:36.905522 32438 consensus_queue.cc:1035] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c523efa47a524c7e98df15899567bf66" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:36.905771 32444 consensus_queue.cc:1035] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64921d1557d544b6837dce8342ecf3de" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:36.920212 32448 mvcc.cc:205] Tried to move back new op lower bound from 7315807915632508928 to 7315807915518181376. Current Snapshot: MvccSnapshot[applied={T|T < 7315807915632508928}]
I20260807 06:58:36.924014 32447 mvcc.cc:205] Tried to move back new op lower bound from 7315807915632508928 to 7315807915518181376. Current Snapshot: MvccSnapshot[applied={T|T < 7315807915632508928}]
I20260807 06:58:36.930680 31749 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:58:36.930912 31749 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:58:36.934109 31749 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Sending DeleteTablet for 3 replicas of tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b
I20260807 06:58:36.935125 32309 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:36 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:36166
I20260807 06:58:36.935236 31911 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:36 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:45048
I20260807 06:58:36.935441 32106 tablet_service.cc:1514] Processing DeleteTablet for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:36 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:47508
I20260807 06:58:36.936431 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 31796
I20260807 06:58:36.951290 32460 tablet_replica.cc:330] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: stopping tablet replica
I20260807 06:58:36.951831 32460 raft_consensus.cc:2229] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:58:36.952472 32460 raft_consensus.cc:2258] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:36.954541 32459 tablet_replica.cc:330] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: stopping tablet replica
I20260807 06:58:36.954697 32461 tablet_replica.cc:330] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: stopping tablet replica
I20260807 06:58:36.954926 32459 raft_consensus.cc:2229] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:58:36.955075 32461 raft_consensus.cc:2229] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:58:36.955549 32461 raft_consensus.cc:2258] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:36.955636 32459 raft_consensus.cc:2258] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:36.957643 32460 ts_tablet_manager.cc:1905] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:36.957818 32424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:36.938184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45062 (local address 127.10.191.129:45905)
0807 06:58:36.938356 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:36.938362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:36.938381 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:58:36.938440 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:36.938446 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:36.938522 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:36.938623 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:36.940677 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.941810 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.943835 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:36.944482 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:36.944600 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:36.948679 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:36.948694 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:36.948709 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:36.948761 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:36.952907 (+ 4146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:36.953870 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:36.953879 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:36.953882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:36.954042 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:36.955400 (+ 1358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:36.955405 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:36.955408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:36.956486 (+ 1078us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:36.956840 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:36.957154 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 06:58:36.957383 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 06:58:36.958650 32001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:36.958806 32461 ts_tablet_manager.cc:1905] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:36.961557 32459 ts_tablet_manager.cc:1905] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:36.965950 32461 ts_tablet_manager.cc:1918] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:36.966117 32461 log.cc:1196] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/9aa1e25bc8a140e6ac507c3d4c8cbc5b
I20260807 06:58:36.966656 32461 ts_tablet_manager.cc:1939] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P 64921d1557d544b6837dce8342ecf3de: Deleting consensus metadata
I20260807 06:58:36.968449 31732 catalog_manager.cc:4841] TS 64921d1557d544b6837dce8342ecf3de (127.10.191.130:46749): tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b (table test-table [id=8c23db17286f40f58dcd238fb62bf282]) successfully deleted
I20260807 06:58:36.970633 32459 ts_tablet_manager.cc:1918] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:36.970892 32459 log.cc:1196] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/9aa1e25bc8a140e6ac507c3d4c8cbc5b
I20260807 06:58:36.971613 32459 ts_tablet_manager.cc:1939] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P d72fb83b7bd54cacb4e8baed68422cf9: Deleting consensus metadata
I20260807 06:58:36.973313 31729 catalog_manager.cc:4841] TS d72fb83b7bd54cacb4e8baed68422cf9 (127.10.191.131:40975): tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b (table test-table [id=8c23db17286f40f58dcd238fb62bf282]) successfully deleted
I20260807 06:58:37.061795 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 31796
W20260807 06:58:37.091078 31729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.191.129:45905 (error 108)
I20260807 06:58:37.091228 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 32015
I20260807 06:58:37.093010 32420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.092575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:45078)
0807 06:58:37.092771 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:37.092883 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 06:58:37.093304 31729 catalog_manager.cc:4584] TS c523efa47a524c7e98df15899567bf66 (127.10.191.129:45905): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9aa1e25bc8a140e6ac507c3d4c8cbc5b: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45905: connect: Connection refused (error 111)
I20260807 06:58:37.107232 32422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.092726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47520 (local address 127.10.191.130:46749)
0807 06:58:37.092926 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:37.092933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:37.092952 (+ 19us) server_negotiation.cc:407] Connection header received
0807 06:58:37.093026 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:37.093031 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:37.093159 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:37.093254 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:37.094660 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:37.095809 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:37.097398 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:37.098050 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:37.098200 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:37.100696 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:37.100716 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:37.100733 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:37.100772 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:37.104284 (+ 3512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:37.104947 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:37.104956 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:37.104959 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:37.105231 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:37.105584 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:37.105589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:37.105592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:37.106049 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:37.106353 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:37.106625 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 06:58:37.106855 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:58:37.108114 32197 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:37.147048 32420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.146435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:45094)
0807 06:58:37.146694 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:37.146806 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260807 06:58:37.148357 32420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.147887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:45108)
0807 06:58:37.148084 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:37.148210 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 06:58:37.195752 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 32015
I20260807 06:58:37.209465 32420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.208630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:45120)
0807 06:58:37.208987 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:37.209238 (+ 251us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190}
I20260807 06:58:37.212031 32420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.211561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:45128)
0807 06:58:37.211761 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:37.211866 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 06:58:37.222555 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 32207
I20260807 06:58:37.237442 32419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.223445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36182 (local address 127.10.191.131:40975)
0807 06:58:37.223610 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:37.223617 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:37.223687 (+ 70us) server_negotiation.cc:407] Connection header received
0807 06:58:37.223901 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:37.223906 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:37.223997 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:37.224111 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:37.225646 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:37.226521 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:37.227783 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:37.228320 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:37.228477 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:37.231323 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:37.231342 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:37.231357 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:37.231398 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:37.234425 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:37.235181 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:37.235190 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:37.235194 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:37.235368 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:37.235766 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:37.235771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:37.235774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:37.236133 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:37.236474 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:37.236828 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 06:58:37.237060 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:58:37.238119 32392 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:37.292825 32420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.292297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:45134)
0807 06:58:37.292561 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:37.292652 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260807 06:58:37.293954 32420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.293577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:45138)
0807 06:58:37.293778 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:37.293845 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 06:58:37.360076 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 32207
I20260807 06:58:37.392911 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 31706
I20260807 06:58:37.394074 31787 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:37.502018 32420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:37.501320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:45905 (local address 127.0.0.1:45140)
0807 06:58:37.501711 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:37.501841 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:45905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169}
I20260807 06:58:37.502040 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 31706
I20260807 06:58:37.532740 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35999
--webserver_interface=127.10.191.190
--webserver_port=40883
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:35999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:37.878882 32470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:37.879155 32470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:37.879243 32470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:37.886240 32470 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:37.886348 32470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:37.886400 32470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:37.886457 32470 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:37.886500 32470 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:37.895808 32470 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:35999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:35999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=40883
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:37.896979 32470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:37.898226 32470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:37.909826 32477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:37.909852 32478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:37.909906 32482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:37.910704 32470 server_base.cc:1034] running on GCE node
I20260807 06:58:37.911410 32470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:37.912755 32470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:37.913966 32470 hybrid_clock.cc:648] HybridClock initialized: now 1786085917913873 us; error 94 us; skew 500 ppm
I20260807 06:58:37.914299 32470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:37 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085917, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:37.917248 32470 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:58:37.918581 32470 webserver.cc:460] Webserver started at http://127.10.191.190:40883/ using document root <none> and password file <none>
I20260807 06:58:37.919245 32470 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:37.919360 32470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:37.924233 32470 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:58:37.927057 32494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:37.928414 32470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:58:37.928592 32470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "0e7fab30fcc56e06a0fb8d2871e8ea4f"
server_key_iv: "614980ac7f096e53b42c264099029e3f"
server_key_version: "encryptionkey@0"
I20260807 06:58:37.929695 32470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:37.971666 32470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:37.975289 32470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:37.975557 32470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:37.994089 32470 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:35999
I20260807 06:58:37.994091 32569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:35999 every 8 connection(s)
I20260807 06:58:37.995585 32470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:58:38.000309 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 32470
I20260807 06:58:38.001197 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:45905
--local_ip_for_outbound_sockets=127.10.191.129
--tserver_master_addrs=127.10.191.190:35999
--webserver_port=43177
--webserver_interface=127.10.191.129
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:58:38.002630 32571 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:58:38.005970 32571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Bootstrap starting.
I20260807 06:58:38.029145 32571 log.cc:824] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:38.051486 32571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:58:38.052167 32571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34: Bootstrap complete.
I20260807 06:58:38.065136 32571 raft_consensus.cc:348] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:38.066429 32571 raft_consensus.cc:729] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82b7878d3ba46d7b0bcb2fc8bba4f34, State: Initialized, Role: FOLLOWER
I20260807 06:58:38.067152 32571 consensus_queue.cc:260] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:38.067432 32571 raft_consensus.cc:388] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:58:38.067580 32571 raft_consensus.cc:482] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:58:38.067790 32571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 2 FOLLOWER]: Advancing to term 3
I20260807 06:58:38.073412 32571 raft_consensus.cc:504] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:38.074033 32571 leader_election.cc:302] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b82b7878d3ba46d7b0bcb2fc8bba4f34; no voters:
I20260807 06:58:38.074738 32571 leader_election.cc:288] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 06:58:38.074877 32575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 06:58:38.076380 32575 raft_consensus.cc:686] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [term 3 LEADER]: Becoming Leader. State: Replica: b82b7878d3ba46d7b0bcb2fc8bba4f34, State: Running, Role: LEADER
I20260807 06:58:38.076898 32575 consensus_queue.cc:237] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } }
I20260807 06:58:38.077370 32571 sys_catalog.cc:564] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:58:38.079425 32578 sys_catalog.cc:455] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b82b7878d3ba46d7b0bcb2fc8bba4f34. Latest consensus state: current_term: 3 leader_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } } }
I20260807 06:58:38.079768 32578 sys_catalog.cc:458] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:38.080307 32577 sys_catalog.cc:455] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82b7878d3ba46d7b0bcb2fc8bba4f34" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 35999 } } }
I20260807 06:58:38.080595 32577 sys_catalog.cc:458] T 00000000000000000000000000000000 P b82b7878d3ba46d7b0bcb2fc8bba4f34 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:38.089612 32581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:58:38.098344 32581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:58:38.099781 32581 catalog_manager.cc:1259] Loaded cluster ID: b22b46e1542b4204a82efb03999e9f31
I20260807 06:58:38.099869 32581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 06:58:38.101964 32581 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0a3d9f19ad google::LogMessage::Fail() at ??:0
@ 0x7f0a3d9f488a google::LogMessage::SendToLog() at ??:0
@ 0x7f0a3d9f14de google::LogMessage::Flush() at ??:0
@ 0x7f0a3d9f2a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0a53424512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f0a53421976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0a534a9610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f0a534a9439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0a4063d345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0a4064091c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f0a40640799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0a4061beaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0a438f56db start_thread at ??:0
@ 0x7f0a3c88b61f clone at ??:0
W20260807 06:58:38.426751 32573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:38.427006 32573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:38.427175 32573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:38.434352 32573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:38.434460 32573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:38.434652 32573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:58:38.443704 32573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:45905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=43177
--tserver_master_addrs=127.10.191.190:35999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:38.444847 32573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:38.446195 32573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:38.458702 32645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:38.458710 32639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:38.458750 32638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:38.459944 32573 server_base.cc:1034] running on GCE node
I20260807 06:58:38.460486 32573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:38.461398 32573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:38.462599 32573 hybrid_clock.cc:648] HybridClock initialized: now 1786085918462561 us; error 24 us; skew 500 ppm
I20260807 06:58:38.462858 32573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:38 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085918, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:38.465935 32573 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:58:38.467269 32573 webserver.cc:460] Webserver started at http://127.10.191.129:43177/ using document root <none> and password file <none>
I20260807 06:58:38.467909 32573 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:38.468010 32573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:38.473212 32573 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260807 06:58:38.478159 32656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:38.479480 32573 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:38.479624 32573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "c523efa47a524c7e98df15899567bf66"
format_stamp: "Formatted at 2026-08-07 06:58:32 on dist-test-slave-tfpf"
server_key: "4538d9c887889b2b636dd695aebd0f74"
server_key_iv: "f1dc843bd0738b6e22f9fd832ff130ec"
server_key_version: "encryptionkey@0"
I20260807 06:58:38.480489 32573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:38.500084 32573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:38.503880 32573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:38.504101 32573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:38.504992 32573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:38.506737 32667 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260807 06:58:38.511714 32667 ts_tablet_manager.cc:1852] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260807 06:58:38.512662 32667 ts_tablet_manager.cc:1905] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:38.519923 32667 ts_tablet_manager.cc:1918] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:38.520164 32667 log.cc:1196] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/9aa1e25bc8a140e6ac507c3d4c8cbc5b
I20260807 06:58:38.520637 32667 ts_tablet_manager.cc:1939] T 9aa1e25bc8a140e6ac507c3d4c8cbc5b P c523efa47a524c7e98df15899567bf66: Deleting consensus metadata
I20260807 06:58:38.521018 32573 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260807 06:58:38.521193 32573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.001s sys 0.000s
I20260807 06:58:38.521315 32573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:38.521400 32573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:38.555773 32573 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:45905
I20260807 06:58:38.555827 351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:45905 every 8 connection(s)
I20260807 06:58:38.557363 32573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:58:38.562225 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:38.560450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:36849)
0807 06:58:38.561216 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:38.561440 (+ 224us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":281,"threads_started":1}
W20260807 06:58:38.562857 352 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:35999 (0 consecutive failures): Network error: Failed to ping master at 127.10.191.190:35999: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
I20260807 06:58:38.563577 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:38.563317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:44295)
0807 06:58:38.563433 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:38.563488 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 06:58:38.564289 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:38.564019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:34511)
0807 06:58:38.564123 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:38.564193 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 06:58:38.564493 352 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:58:38.567802 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 32573
I20260807 06:58:38.568518 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:46749
--local_ip_for_outbound_sockets=127.10.191.130
--tserver_master_addrs=127.10.191.190:35999
--webserver_port=35169
--webserver_interface=127.10.191.130
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:38.898479 355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:38.898741 355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:38.898833 355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:38.905442 355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:38.905532 355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:38.905627 355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:58:38.914499 355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:46749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=35169
--tserver_master_addrs=127.10.191.190:35999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:38.915568 355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:38.917040 355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:38.930001 361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:38.930038 362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:38.930526 364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:38.930860 355 server_base.cc:1034] running on GCE node
I20260807 06:58:38.931384 355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:38.932264 355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:38.933495 355 hybrid_clock.cc:648] HybridClock initialized: now 1786085918933452 us; error 51 us; skew 500 ppm
I20260807 06:58:38.933772 355 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:38 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085918, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:38.936811 355 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:58:38.938388 355 webserver.cc:460] Webserver started at http://127.10.191.130:35169/ using document root <none> and password file <none>
I20260807 06:58:38.939064 355 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:38.939220 355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:38.944469 355 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:58:38.947184 374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:38.948491 355 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:38.948652 355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "64921d1557d544b6837dce8342ecf3de"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "2b0e2e920da4a1d601db255dd48bc259"
server_key_iv: "1b28399fe77667750d7c02235df79869"
server_key_version: "encryptionkey@0"
I20260807 06:58:38.949676 355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:38.962798 355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:38.966217 355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:38.966496 355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:38.969524 355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:38.971274 355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:38.971438 355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:38.971560 355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:38.971644 355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:39.004140 355 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:46749
I20260807 06:58:39.004230 538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:46749 every 8 connection(s)
I20260807 06:58:39.005628 355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:58:39.008455 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 355
I20260807 06:58:39.009336 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:40975
--local_ip_for_outbound_sockets=127.10.191.131
--tserver_master_addrs=127.10.191.190:35999
--webserver_port=44387
--webserver_interface=127.10.191.131
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:58:39.010586 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:39.008532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:60463)
0807 06:58:39.009395 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:39.009774 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":332,"threads_started":1}
W20260807 06:58:39.011404 541 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:35999 (0 consecutive failures): Network error: Failed to ping master at 127.10.191.190:35999: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
I20260807 06:58:39.012248 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:39.011912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:53781)
0807 06:58:39.012082 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:39.012150 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 06:58:39.013201 543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:39.012858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:44807)
0807 06:58:39.012986 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:39.013054 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 06:58:39.013479 541 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:58:39.343278 544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:39.343554 544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:39.343715 544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:39.352023 544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:39.352227 544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:39.352424 544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:58:39.365592 544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:40975
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=44387
--tserver_master_addrs=127.10.191.190:35999
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:39.366772 544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:39.368108 544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:39.381299 554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:39.381326 550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:39.381359 551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:39.382457 544 server_base.cc:1034] running on GCE node
I20260807 06:58:39.383049 544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:39.384102 544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:39.385308 544 hybrid_clock.cc:648] HybridClock initialized: now 1786085919385247 us; error 55 us; skew 500 ppm
I20260807 06:58:39.385632 544 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:39 dist-test-slave-tfpf krb5kdc[30906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085919, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:39.389348 544 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:58:39.391104 544 webserver.cc:460] Webserver started at http://127.10.191.131:44387/ using document root <none> and password file <none>
I20260807 06:58:39.391759 544 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:39.391870 544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:39.397572 544 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:58:39.400233 568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:39.401554 544 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:58:39.401734 544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "d72fb83b7bd54cacb4e8baed68422cf9"
format_stamp: "Formatted at 2026-08-07 06:58:33 on dist-test-slave-tfpf"
server_key: "32a79dff62ecaae66efba1963bd8ddc1"
server_key_iv: "30a92d7921ac8f7dff10ca6510054561"
server_key_version: "encryptionkey@0"
I20260807 06:58:39.402793 544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:39.422307 544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:39.426229 544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:39.426473 544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:39.427390 544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:39.428735 544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:39.428833 544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:39.428941 544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:39.429006 544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:39.463872 544 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:40975
I20260807 06:58:39.463925 726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:40975 every 8 connection(s)
I20260807 06:58:39.465590 544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:58:39.470788 730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:39.468509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:47243)
0807 06:58:39.469363 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:39.469711 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":280,"threads_started":1}
W20260807 06:58:39.471485 727 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:35999 (0 consecutive failures): Network error: Failed to ping master at 127.10.191.190:35999: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
I20260807 06:58:39.472225 730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:39.471932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:46207)
0807 06:58:39.472054 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:39.472124 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 06:58:39.472982 730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:39.472691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:44545)
0807 06:58:39.472813 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:39.472880 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 06:58:39.473243 727 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:58:39.473599 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 544
I20260807 06:58:39.565740 733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:39.564977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:60119)
0807 06:58:39.565445 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:39.565523 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":261,"threads_started":1}
I20260807 06:58:40.014639 735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:40.013919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:50709)
0807 06:58:40.014323 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:40.014439 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":193,"threads_started":1}
I20260807 06:58:40.474464 736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:40.473731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:51133)
0807 06:58:40.474142 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:40.474253 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":207,"threads_started":1}
I20260807 06:58:40.567445 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:40.566662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:34403)
0807 06:58:40.567192 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:40.567304 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":298,"threads_started":1}
I20260807 06:58:41.016232 738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:41.015530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:57997)
0807 06:58:41.016016 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:41.016088 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":280,"threads_started":1}
I20260807 06:58:41.476266 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:41.475438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:58243)
0807 06:58:41.476022 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:41.476100 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":306,"threads_started":1}
I20260807 06:58:41.569244 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:41.568416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:39221)
0807 06:58:41.568934 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:41.569017 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":288,"threads_started":1}
I20260807 06:58:42.017985 745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:42.017284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:50211)
0807 06:58:42.017721 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:42.017802 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":231,"threads_started":1}
I20260807 06:58:42.477838 746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:42.477199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:36421)
0807 06:58:42.477598 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:42.477678 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":207,"threads_started":1}
I20260807 06:58:42.570890 747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:42.570091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:49285)
0807 06:58:42.570594 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:42.570674 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":243,"threads_started":1}
I20260807 06:58:43.019665 748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:43.018939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:44947)
0807 06:58:43.019381 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:43.019459 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":232,"threads_started":1}
I20260807 06:58:43.479430 749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:43.478731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:56037)
0807 06:58:43.479161 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:43.479247 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":225,"threads_started":1}
I20260807 06:58:43.572423 750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:43.571740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:51469)
0807 06:58:43.572199 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:43.572272 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":225,"threads_started":1}
I20260807 06:58:44.021549 751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:44.020758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:45485)
0807 06:58:44.021300 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:44.021380 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":255,"threads_started":1}
I20260807 06:58:44.481290 755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:44.480424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:58607)
0807 06:58:44.480991 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:44.481132 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":342,"threads_started":1}
I20260807 06:58:44.574110 756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:44.573438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:59657)
0807 06:58:44.573862 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:44.573941 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":217,"threads_started":1}
I20260807 06:58:45.023118 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:45.022398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:44135)
0807 06:58:45.022869 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:45.022958 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":230,"threads_started":1}
I20260807 06:58:45.482720 758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:45.482102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:47393)
0807 06:58:45.482488 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:45.482576 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":196,"threads_started":1}
I20260807 06:58:45.575893 762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:45.575067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:51957)
0807 06:58:45.575599 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:45.575686 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":250,"threads_started":1}
I20260807 06:58:46.024956 763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:46.024159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:35219)
0807 06:58:46.024630 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:46.024724 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":212,"threads_started":1}
I20260807 06:58:46.484356 764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:46.483605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:42697)
0807 06:58:46.484090 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:46.484163 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":207,"threads_started":1}
I20260807 06:58:46.577754 768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:46.576904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:45329)
0807 06:58:46.577476 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:46.577584 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":336,"threads_started":1}
I20260807 06:58:47.026482 770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:47.025830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:41105)
0807 06:58:47.026252 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:47.026329 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":210,"threads_started":1}
I20260807 06:58:47.486114 772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:47.485385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:50653)
0807 06:58:47.485867 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:47.485951 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":246,"threads_started":1}
I20260807 06:58:47.579368 773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:47.578625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:52625)
0807 06:58:47.579108 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:47.579201 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":241,"threads_started":1}
I20260807 06:58:48.028169 774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:48.027379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:54549)
0807 06:58:48.027896 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:48.027973 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":268,"threads_started":1}
I20260807 06:58:48.487704 775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:48.486891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:43035)
0807 06:58:48.487443 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:48.487523 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":310,"threads_started":1}
I20260807 06:58:48.580940 776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:48.580250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:37855)
0807 06:58:48.580696 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:48.580776 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":232,"threads_started":1}
I20260807 06:58:49.029868 777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:49.029151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:50645)
0807 06:58:49.029627 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:49.029706 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":269,"threads_started":1}
I20260807 06:58:49.489444 778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:49.488725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:51371)
0807 06:58:49.489212 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:49.489288 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":228,"threads_started":1}
I20260807 06:58:49.582540 779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:49.581827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:43269)
0807 06:58:49.582278 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:49.582356 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":265,"threads_started":1}
I20260807 06:58:50.031430 780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:50.030757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:42075)
0807 06:58:50.031185 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:50.031267 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":226,"threads_started":1}
I20260807 06:58:50.490957 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:50.490249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:38935)
0807 06:58:50.490692 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:50.490781 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":220,"threads_started":1}
I20260807 06:58:50.584321 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:50.583662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:47311)
0807 06:58:50.584089 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:50.584169 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":216,"threads_started":1}
I20260807 06:58:51.033185 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:51.032358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:43651)
0807 06:58:51.032855 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:51.032931 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":299,"threads_started":1}
I20260807 06:58:51.492592 785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:51.491915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:47913)
0807 06:58:51.492343 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:51.492417 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":235,"threads_started":1}
I20260807 06:58:51.586042 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:51.585281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:51357)
0807 06:58:51.585735 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:51.585834 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":226,"threads_started":1}
I20260807 06:58:52.034982 788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:52.034199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:47587)
0807 06:58:52.034697 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:52.034787 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":234,"threads_started":1}
I20260807 06:58:52.494326 789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:52.493519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:45981)
0807 06:58:52.494041 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:52.494134 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":245,"threads_started":1}
I20260807 06:58:52.587724 790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:52.586964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:47481)
0807 06:58:52.587448 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:52.587531 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":247,"threads_started":1}
I20260807 06:58:53.036823 791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:53.035946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:39965)
0807 06:58:53.036451 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:53.036539 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":285,"threads_started":1}
I20260807 06:58:53.496160 792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:53.495454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:35847)
0807 06:58:53.495889 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:53.495972 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":212,"threads_started":1}
I20260807 06:58:53.589743 793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:53.588934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.129:34111)
0807 06:58:53.589424 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:53.589534 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":278,"threads_started":1}
I20260807 06:58:54.038628 794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:54.037901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.130:44369)
0807 06:58:54.038343 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:54.038440 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":218,"threads_started":1}
I20260807 06:58:54.474853 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 32573
I20260807 06:58:54.498035 795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:54.476200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37436 (local address 127.10.191.129:45905)
0807 06:58:54.476941 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:54.476967 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:54.477028 (+ 61us) server_negotiation.cc:407] Connection header received
0807 06:58:54.479468 (+ 2440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:54.479485 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:54.480094 (+ 609us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:54.480503 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:54.482146 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:54.483844 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:54.485525 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:54.486419 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:54.486627 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:54.490018 (+ 3391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:54.490029 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:54.490054 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:54.490093 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:54.494003 (+ 3910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:54.494748 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:54.494757 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:54.494765 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:54.494986 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:54.495432 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:54.495437 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:54.495440 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:54.496024 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:54.496344 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:54.497407 (+ 1063us) server_negotiation.cc:299] Negotiation successful
0807 06:58:54.497750 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":361,"threads_started":1}
I20260807 06:58:54.498154 797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:54.497323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:35999 (local address 127.10.191.131:54201)
0807 06:58:54.497829 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:54.497940 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:35999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":281,"threads_started":1}
I20260807 06:58:54.499400 347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:54.586679 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 32573
I20260807 06:58:54.617045 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 355
I20260807 06:58:54.635690 800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:54.618115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60972 (local address 127.10.191.130:46749)
0807 06:58:54.618628 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:54.618643 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:54.618684 (+ 41us) server_negotiation.cc:407] Connection header received
0807 06:58:54.620358 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:54.620368 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:54.620811 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:54.621213 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:54.622775 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:54.624033 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:54.625487 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:54.626160 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:54.626404 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:54.629168 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:54.629178 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:54.629193 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:54.629245 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:54.632075 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:54.632874 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:54.632883 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:54.632893 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:54.633198 (+ 305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:54.633655 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:54.633662 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:54.633666 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:54.634175 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:54.634502 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:54.634971 (+ 469us) server_negotiation.cc:299] Negotiation successful
0807 06:58:54.635397 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":242,"threads_started":1}
I20260807 06:58:54.637157 530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:54.721894 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 355
I20260807 06:58:54.751543 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 544
I20260807 06:58:54.769013 804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:54.752682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34054 (local address 127.10.191.131:40975)
0807 06:58:54.753400 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:54.753415 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:54.753458 (+ 43us) server_negotiation.cc:407] Connection header received
0807 06:58:54.755142 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:54.755151 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:54.755580 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:54.755874 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:54.757317 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:54.758521 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:54.759739 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:54.760351 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:54.760484 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:54.763101 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:54.763109 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:54.763121 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:54.763155 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:54.766066 (+ 2911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:54.766744 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:54.766750 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:54.766755 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:54.766918 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:54.767262 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:54.767265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:54.767267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:54.767758 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:54.767974 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:54.768282 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 06:58:54.768723 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":395,"threads_started":1}
I20260807 06:58:54.770341 719 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:54.852563 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 544
2026-08-07T06:58:54Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24711 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 06:58:54 dist-test-slave-tfpf krb5kdc[809](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 06:58:54 dist-test-slave-tfpf krb5kdc[809](info): set up 2 sockets
Aug 07 06:58:54 dist-test-slave-tfpf krb5kdc[809](info): commencing operation
krb5kdc: starting...
W20260807 06:58:56.136756 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.005s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 06:58:56 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T06:58:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T06:58:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 06:58:56.422652 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:45771
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:45771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:56.768729 827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:56.768992 827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:56.769129 827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:56.775990 827 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 06:58:56.776083 827 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 06:58:56.776120 827 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 06:58:56.776165 827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:58:56.776237 827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:56.776335 827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:56.776417 827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:58:56.776538 827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:58:56.786160 827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:45771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:45771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:56.787453 827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:56.788811 827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:56.800673 833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:56.800747 838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:56.800709 835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:56.801029 827 server_base.cc:1034] running on GCE node
I20260807 06:58:56.802065 827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:56.803288 827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:56.804559 827 hybrid_clock.cc:648] HybridClock initialized: now 1786085936804484 us; error 42 us; skew 500 ppm
I20260807 06:58:56.804934 827 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:56 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085936, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:56.808441 827 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:58:56.810065 827 webserver.cc:460] Webserver started at http://127.10.191.190:43919/ using document root <none> and password file <none>
I20260807 06:58:56.810765 827 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:56.810879 827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:56.811233 827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:56.814083 827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "624028a3f9df4ddb9784922fe36650b5"
format_stamp: "Formatted at 2026-08-07 06:58:56 on dist-test-slave-tfpf"
server_key: "13972f01a31550e8aa38d380b867d3e9"
server_key_iv: "23f65b6fd2849e2bc834fa91cdabf108"
server_key_version: "encryptionkey@0"
I20260807 06:58:56.814807 827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "624028a3f9df4ddb9784922fe36650b5"
format_stamp: "Formatted at 2026-08-07 06:58:56 on dist-test-slave-tfpf"
server_key: "13972f01a31550e8aa38d380b867d3e9"
server_key_iv: "23f65b6fd2849e2bc834fa91cdabf108"
server_key_version: "encryptionkey@0"
I20260807 06:58:56.819708 827 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 06:58:56.823087 849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:56.824396 827 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 06:58:56.824594 827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "624028a3f9df4ddb9784922fe36650b5"
format_stamp: "Formatted at 2026-08-07 06:58:56 on dist-test-slave-tfpf"
server_key: "13972f01a31550e8aa38d380b867d3e9"
server_key_iv: "23f65b6fd2849e2bc834fa91cdabf108"
server_key_version: "encryptionkey@0"
I20260807 06:58:56.824842 827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:56.853914 827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:56.857836 827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:56.858120 827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:56.876622 827 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:45771
I20260807 06:58:56.876642 936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:45771 every 8 connection(s)
I20260807 06:58:56.878100 827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:58:56.879115 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 827
I20260807 06:58:56.879359 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 06:58:56.880275 11006 external_mini_cluster.cc:1428] Setting key 39bd052b893f7ac28012f9aa924df9c3
I20260807 06:58:56.882983 937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 06:58:56 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:56.895623 937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Bootstrap starting.
I20260807 06:58:56.899956 937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:56.901271 937 log.cc:824] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:56.904458 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:56.882434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37798 (local address 127.10.191.190:45771)
0807 06:58:56.883240 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:56.883250 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:56.883294 (+ 44us) server_negotiation.cc:407] Connection header received
0807 06:58:56.884794 (+ 1500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:56.884814 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:56.885197 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:56.885506 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:56.887226 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:56.888506 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:56.890454 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:56.891092 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:56.891221 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:56.895909 (+ 4688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:56.895930 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:56.895946 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:56.896007 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:56.899945 (+ 3938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:56.900617 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:56.900625 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:56.900633 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:56.900868 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:56.901318 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:56.901323 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:56.901326 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:56.901998 (+ 672us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:56.902224 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:56.902803 (+ 579us) server_negotiation.cc:299] Negotiation successful
0807 06:58:56.903218 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":366,"threads_started":1}
I20260807 06:58:56.904475 937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: No bootstrap required, opened a new log
I20260807 06:58:56.912060 937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:58:56.912475 937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:56.912559 937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624028a3f9df4ddb9784922fe36650b5, State: Initialized, Role: FOLLOWER
I20260807 06:58:56.913043 937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:58:56.913316 937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:58:56.913419 937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:58:56.913547 937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:56.915757 937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:58:56.916162 937 leader_election.cc:302] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 624028a3f9df4ddb9784922fe36650b5; no voters:
I20260807 06:58:56.916668 937 leader_election.cc:288] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 06:58:56.916880 943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:58:56.917666 943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 1 LEADER]: Becoming Leader. State: Replica: 624028a3f9df4ddb9784922fe36650b5, State: Running, Role: LEADER
I20260807 06:58:56.918269 943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:58:56.918859 937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:58:56.921329 945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 624028a3f9df4ddb9784922fe36650b5. Latest consensus state: current_term: 1 leader_uuid: "624028a3f9df4ddb9784922fe36650b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } } }
I20260807 06:58:56.921835 945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:56.921336 944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "624028a3f9df4ddb9784922fe36650b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } } }
I20260807 06:58:56.923384 944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:58:56.924789 951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:58:56.930697 951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:58:56.938696 951 catalog_manager.cc:1347] Generated new cluster ID: e4151cfbbef540e2b89c92390e7b5189
I20260807 06:58:56.938800 951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:58:56.973227 951 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 06:58:56.975428 951 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:58:56.987469 951 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Generated new TSK 0
I20260807 06:58:56.988405 951 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 06:58:57.072662 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:45771
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:57.433152 973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:57.433429 973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:57.433616 973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:57.440560 973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:57.440658 973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:57.440835 973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:58:57.450843 973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:45771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:57.452328 973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:57.453850 973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:57.466970 979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:57.466877 981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:57.466921 984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:57.467866 973 server_base.cc:1034] running on GCE node
I20260807 06:58:57.468544 973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:57.469475 973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:57.470674 973 hybrid_clock.cc:648] HybridClock initialized: now 1786085937470629 us; error 31 us; skew 500 ppm
I20260807 06:58:57.470983 973 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:57 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085937, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:57.474045 973 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:58:57.475334 973 webserver.cc:460] Webserver started at http://127.10.191.129:33663/ using document root <none> and password file <none>
I20260807 06:58:57.475937 973 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:57.476037 973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:57.476279 973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:57.479086 973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "2a0058be4b2d4024876ce14f06eb705b"
format_stamp: "Formatted at 2026-08-07 06:58:57 on dist-test-slave-tfpf"
server_key: "fb77aaf884dd265cb7b9e37279a76074"
server_key_iv: "2e7267821e6c8cc5de96b6e7544f1a79"
server_key_version: "encryptionkey@0"
I20260807 06:58:57.479799 973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "2a0058be4b2d4024876ce14f06eb705b"
format_stamp: "Formatted at 2026-08-07 06:58:57 on dist-test-slave-tfpf"
server_key: "fb77aaf884dd265cb7b9e37279a76074"
server_key_iv: "2e7267821e6c8cc5de96b6e7544f1a79"
server_key_version: "encryptionkey@0"
I20260807 06:58:57.484795 973 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 06:58:57.488183 995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:57.489547 973 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:58:57.489732 973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "2a0058be4b2d4024876ce14f06eb705b"
format_stamp: "Formatted at 2026-08-07 06:58:57 on dist-test-slave-tfpf"
server_key: "fb77aaf884dd265cb7b9e37279a76074"
server_key_iv: "2e7267821e6c8cc5de96b6e7544f1a79"
server_key_version: "encryptionkey@0"
I20260807 06:58:57.489940 973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:57.503633 973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:57.507267 973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:57.507551 973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:57.508447 973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:57.509843 973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:57.509950 973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:57.510099 973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:57.510174 973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:57.543342 973 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:40355
I20260807 06:58:57.543392 1172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:40355 every 8 connection(s)
I20260807 06:58:57.544703 973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:58:57.553160 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 973
I20260807 06:58:57.553393 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 06:58:57.554118 11006 external_mini_cluster.cc:1428] Setting key d15d80d2aef70c769d93c958538d4a5e
Aug 07 06:58:57 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085937, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:57.566951 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:57.547398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:59869 (local address 127.10.191.190:45771)
0807 06:58:57.547886 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:57.547891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:57.548699 (+ 808us) server_negotiation.cc:407] Connection header received
0807 06:58:57.550666 (+ 1967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:57.550673 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:57.550767 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:57.550895 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:57.552412 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:57.553550 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:57.555308 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:57.555912 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:57.556075 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:57.559841 (+ 3766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:57.559850 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:57.559857 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:57.559904 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:57.563497 (+ 3593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:57.564333 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:57.564341 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:57.564347 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:57.564510 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:57.564920 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:57.564927 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:57.564933 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:57.565391 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:57.565550 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:57.566227 (+ 677us) server_negotiation.cc:299] Negotiation successful
0807 06:58:57.566481 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":268,"threads_started":1}
I20260807 06:58:57.567664 1178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:57.547806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:59869)
0807 06:58:57.548520 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:57.548560 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:57.550380 (+ 1820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:57.551139 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:57.551147 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:57.551651 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:57.552228 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:57.552246 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:57.553725 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:57.553729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:57.555171 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:57.555184 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:57.556164 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:57.556171 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:57.556424 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:57.557174 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:57.557197 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:57.559597 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:57.563722 (+ 4125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:57.563729 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:57.563741 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:57.564206 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:57.564620 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:57.564623 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:57.564625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:57.564810 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:57.565523 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:57.565529 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:57.565842 (+ 313us) client_negotiation.cc:769] Sending connection context
0807 06:58:57.566073 (+ 231us) client_negotiation.cc:240] Negotiation successful
0807 06:58:57.566479 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":284,"threads_started":1}
I20260807 06:58:57.569387 1175 heartbeater.cc:347] Connected to a master server at 127.10.191.190:45771
I20260807 06:58:57.569732 1175 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:57.570609 1175 heartbeater.cc:511] Master 127.10.191.190:45771 requested a full tablet report, sending...
I20260807 06:58:57.572801 879 ts_manager.cc:194] Registered new tserver with Master: 2a0058be4b2d4024876ce14f06eb705b (127.10.191.129:40355)
I20260807 06:58:57.574380 879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:59869
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 06:58:57.620820 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:45771
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:57.976061 1182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:57.976354 1182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:57.976536 1182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:57.983417 1182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:57.983563 1182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:57.983729 1182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:58:57.993486 1182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:45771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:57.994810 1182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:57.996147 1182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:58.009004 1190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:58.008971 1192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:58.008941 1188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:58.009917 1182 server_base.cc:1034] running on GCE node
I20260807 06:58:58.010702 1182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:58.011716 1182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:58.012908 1182 hybrid_clock.cc:648] HybridClock initialized: now 1786085938012857 us; error 52 us; skew 500 ppm
I20260807 06:58:58.013233 1182 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:58 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085938, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:58.020300 1182 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:58:58.021675 1182 webserver.cc:460] Webserver started at http://127.10.191.130:42789/ using document root <none> and password file <none>
I20260807 06:58:58.022264 1182 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:58.022361 1182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:58.022605 1182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:58.025386 1182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "748b3d240da54dc794e423b3b2353879"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "52d62db5a6dabe644eecc89b6ce7340f"
server_key_iv: "910f030943f7fb7034a54af846d2b681"
server_key_version: "encryptionkey@0"
I20260807 06:58:58.026098 1182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "748b3d240da54dc794e423b3b2353879"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "52d62db5a6dabe644eecc89b6ce7340f"
server_key_iv: "910f030943f7fb7034a54af846d2b681"
server_key_version: "encryptionkey@0"
I20260807 06:58:58.031316 1182 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 06:58:58.034592 1199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:58.035854 1182 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 06:58:58.036031 1182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "748b3d240da54dc794e423b3b2353879"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "52d62db5a6dabe644eecc89b6ce7340f"
server_key_iv: "910f030943f7fb7034a54af846d2b681"
server_key_version: "encryptionkey@0"
I20260807 06:58:58.036217 1182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:58.055543 1182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:58.059796 1182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:58.060092 1182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:58.061022 1182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:58.062283 1182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:58.062387 1182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:58.062520 1182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:58.062599 1182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:58.095580 1182 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:42053
I20260807 06:58:58.095629 1356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:42053 every 8 connection(s)
I20260807 06:58:58.096832 1182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:58:58.097923 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 1182
I20260807 06:58:58.098115 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 06:58:58.098726 11006 external_mini_cluster.cc:1428] Setting key 78fc079f8cf0944e64c6e2b146cd1e25
Aug 07 06:58:58 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085938, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:58.118518 1360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.099572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:34631 (local address 127.10.191.190:45771)
0807 06:58:58.100079 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:58.100085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:58.101112 (+ 1027us) server_negotiation.cc:407] Connection header received
0807 06:58:58.102897 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:58.102905 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:58.102994 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:58.103120 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:58.104517 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.105685 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.107118 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.107849 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.107988 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.111308 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:58.111317 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:58.111325 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:58.111373 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:58.115106 (+ 3733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:58.116075 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:58.116079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:58.116081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:58.116234 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:58.116745 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:58.116748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:58.116751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:58.117001 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:58.117191 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:58.118004 (+ 813us) server_negotiation.cc:299] Negotiation successful
0807 06:58:58.118194 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":247,"threads_started":1}
I20260807 06:58:58.120045 1361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.100080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:34631)
0807 06:58:58.100917 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:58.100971 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:58.102643 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:58.103306 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:58.103312 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:58.103798 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:58.104333 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.104350 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.105826 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.105829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.106961 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.106973 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.108056 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.108060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.108242 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.108889 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:58.108910 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:58.111075 (+ 2165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:58.115254 (+ 4179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:58.115264 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:58.115283 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:58.115947 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:58.116357 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:58.116363 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:58.116370 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:58.116614 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:58.117156 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:58.117166 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:58.117626 (+ 460us) client_negotiation.cc:769] Sending connection context
0807 06:58:58.117937 (+ 311us) client_negotiation.cc:240] Negotiation successful
0807 06:58:58.118542 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":345,"threads_started":1}
I20260807 06:58:58.121601 1358 heartbeater.cc:347] Connected to a master server at 127.10.191.190:45771
I20260807 06:58:58.121948 1358 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:58.122680 1358 heartbeater.cc:511] Master 127.10.191.190:45771 requested a full tablet report, sending...
I20260807 06:58:58.124197 879 ts_manager.cc:194] Registered new tserver with Master: 748b3d240da54dc794e423b3b2353879 (127.10.191.130:42053)
I20260807 06:58:58.125010 879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:34631
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 06:58:58.166308 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:45771
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:58:58.508616 1364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:58:58.508942 1364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:58:58.509168 1364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:58:58.516559 1364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:58:58.516744 1364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:58:58.516938 1364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:58:58.526536 1364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:45771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:58:58.527747 1364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:58:58.529273 1364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:58:58.542328 1372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:58.545271 1374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:58:58.545493 1376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:58:58.546649 1364 server_base.cc:1034] running on GCE node
I20260807 06:58:58.547379 1364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:58:58.548492 1364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:58:58.549693 1364 hybrid_clock.cc:648] HybridClock initialized: now 1786085938549634 us; error 56 us; skew 500 ppm
I20260807 06:58:58.550088 1364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:58:58 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085938, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:58:58.553329 1364 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:58:58.554643 1364 webserver.cc:460] Webserver started at http://127.10.191.131:34103/ using document root <none> and password file <none>
I20260807 06:58:58.555351 1364 fs_manager.cc:359] Metadata directory not provided
I20260807 06:58:58.555483 1364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:58:58.555810 1364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 06:58:58.558831 1364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "631459c1af0640a1ab60de1f3e304f9a"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "ae415f0494d036a985076e752b80e7bc"
server_key_iv: "d2334eebffcbe78cb432beee2cad40c6"
server_key_version: "encryptionkey@0"
I20260807 06:58:58.559574 1364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "631459c1af0640a1ab60de1f3e304f9a"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "ae415f0494d036a985076e752b80e7bc"
server_key_iv: "d2334eebffcbe78cb432beee2cad40c6"
server_key_version: "encryptionkey@0"
I20260807 06:58:58.564690 1364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 06:58:58.568012 1383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:58.569330 1364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:58:58.569504 1364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "631459c1af0640a1ab60de1f3e304f9a"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "ae415f0494d036a985076e752b80e7bc"
server_key_iv: "d2334eebffcbe78cb432beee2cad40c6"
server_key_version: "encryptionkey@0"
I20260807 06:58:58.569698 1364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:58:58.577289 1175 heartbeater.cc:503] Master 127.10.191.190:45771 was elected leader, sending a full tablet report...
I20260807 06:58:58.585237 1364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:58:58.589313 1364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:58:58.589608 1364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:58:58.590639 1364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:58:58.591976 1364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:58:58.592087 1364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:58.592259 1364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:58:58.592334 1364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:58:58.626386 1364 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:45689
I20260807 06:58:58.626425 1552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:45689 every 8 connection(s)
I20260807 06:58:58.627681 1364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:58:58.631616 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 1364
I20260807 06:58:58.631831 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 06:58:58.632393 11006 external_mini_cluster.cc:1428] Setting key 846b752ebefa1c83af2d445f01aacd96
Aug 07 06:58:58 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085938, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:58:58.648818 1556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.630521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:52437 (local address 127.10.191.190:45771)
0807 06:58:58.630971 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:58.630976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:58.632190 (+ 1214us) server_negotiation.cc:407] Connection header received
0807 06:58:58.634617 (+ 2427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:58.634641 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:58.634729 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:58.634863 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:58.636438 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.637317 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.638843 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.639272 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.639440 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.642817 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:58.642821 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:58.642825 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:58.642856 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:58.645400 (+ 2544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:58.646222 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:58.646226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:58.646228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:58.646349 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:58.646870 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:58.646874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:58.646876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:58.647232 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:58.647403 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:58.648156 (+ 753us) server_negotiation.cc:299] Negotiation successful
0807 06:58:58.648385 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":224,"threads_started":1}
I20260807 06:58:58.649709 1557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.631111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:52437)
0807 06:58:58.632007 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:58.632051 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:58.634294 (+ 2243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:58.635106 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:58.635114 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:58.635745 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:58:58.636270 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.636288 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.637485 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.637490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.638698 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.638710 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.639542 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.639550 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.639797 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.640475 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:58:58.640501 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:58:58.642599 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:58:58.645536 (+ 2937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:58.645544 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:58.645557 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:58.646031 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:58.646471 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:58:58.646476 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:58:58.646482 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:58:58.646733 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:58:58.647366 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:58:58.647374 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:58:58.647750 (+ 376us) client_negotiation.cc:769] Sending connection context
0807 06:58:58.648044 (+ 294us) client_negotiation.cc:240] Negotiation successful
0807 06:58:58.648553 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":382,"threads_started":1}
I20260807 06:58:58.650954 1554 heartbeater.cc:347] Connected to a master server at 127.10.191.190:45771
I20260807 06:58:58.651260 1554 heartbeater.cc:464] Registering TS with master...
I20260807 06:58:58.651966 1554 heartbeater.cc:511] Master 127.10.191.190:45771 requested a full tablet report, sending...
I20260807 06:58:58.653353 879 ts_manager.cc:194] Registered new tserver with Master: 631459c1af0640a1ab60de1f3e304f9a (127.10.191.131:45689)
I20260807 06:58:58.654178 879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:52437
I20260807 06:58:58.659837 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:58:58.678038 1556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.664406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37806 (local address 127.10.191.190:45771)
0807 06:58:58.664550 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:58.664556 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:58.665005 (+ 449us) server_negotiation.cc:407] Connection header received
0807 06:58:58.665256 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:58.665259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:58.665343 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:58.665467 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:58.666968 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.667717 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.669317 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.669700 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.669835 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.672391 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:58.672396 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:58.672399 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:58.672450 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:58.675185 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:58.675913 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:58.675919 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:58.675922 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:58.676071 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:58.676463 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:58.676469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:58.676474 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:58.676809 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:58.677137 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:58.677480 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 06:58:58.677717 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 06:58:58.682192 879 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:58:58.688917 879 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:58:58.714273 1573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.700976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:40355 (local address 127.0.0.1:35022)
0807 06:58:58.701671 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:58.701726 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:58.701894 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:58.703684 (+ 1790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:58.703694 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:58.703739 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:58.704219 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.704235 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.706888 (+ 2653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.706896 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.710020 (+ 3124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.710042 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.712945 (+ 2903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.712954 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.713298 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.713372 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 06:58:58.713530 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 06:58:58.713764 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":292,"threads_started":1}
I20260807 06:58:58.715265 1574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.701216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35022 (local address 127.10.191.129:40355)
0807 06:58:58.702693 (+ 1477us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:58.702702 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:58.702731 (+ 29us) server_negotiation.cc:407] Connection header received
0807 06:58:58.702867 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:58.702875 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:58.703118 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:58.703344 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:58.704493 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.706661 (+ 2168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.710294 (+ 3633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.712306 (+ 2012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.712548 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.712773 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:58.714715 (+ 1942us) server_negotiation.cc:299] Negotiation successful
0807 06:58:58.714892 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1303,"thread_start_us":1123,"threads_started":1}
I20260807 06:58:58.719846 1072 tablet_service.cc:1467] Processing CreateTablet for tablet f058b640ee1a41049c7395dc0093043d (DEFAULT_TABLE table=test-table [id=72549c37ae874e13b15f96df651b9948]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:58.721541 1072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f058b640ee1a41049c7395dc0093043d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:58.722313 1580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.701297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:42053 (local address 127.0.0.1:59936)
0807 06:58:58.714117 (+ 12820us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:58.714137 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:58.714272 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:58.715484 (+ 1212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:58.715488 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:58.715522 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:58.715935 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.715953 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.717835 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.717843 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.719868 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.719888 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.721416 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.721422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.721602 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.721666 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 06:58:58.721784 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 06:58:58.721927 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12670,"mutex_wait_us":63,"thread_start_us":13926,"threads_started":1}
I20260807 06:58:58.722354 1579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.701849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59936 (local address 127.10.191.130:42053)
0807 06:58:58.714548 (+ 12699us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:58.714557 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:58.714594 (+ 37us) server_negotiation.cc:407] Connection header received
0807 06:58:58.714717 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:58.714728 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:58.715025 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:58.716130 (+ 1105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:58.716426 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.717702 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.720050 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.721189 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.721366 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.721537 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:58.721861 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 06:58:58.722033 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12500,"thread_start_us":12371,"threads_started":1}
I20260807 06:58:58.723860 1576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.703293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:45689 (local address 127.0.0.1:43034)
0807 06:58:58.714895 (+ 11602us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:58.714912 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:58.715024 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:58.716246 (+ 1222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:58.716250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:58.716274 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:58.716694 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.716706 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.718724 (+ 2018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.718732 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.720869 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:58.720885 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.723074 (+ 2189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.723081 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:58.723264 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.723295 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 06:58:58.723398 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 06:58:58.723530 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11489,"mutex_wait_us":1,"thread_start_us":11069,"threads_started":1}
I20260807 06:58:58.724004 1581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:58.703702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43034 (local address 127.10.191.131:45689)
0807 06:58:58.715618 (+ 11916us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:58.715627 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:58.715661 (+ 34us) server_negotiation.cc:407] Connection header received
0807 06:58:58.715787 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:58.715795 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:58.716033 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:58.716230 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:58.716918 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.718542 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.721107 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:58.722549 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:58.722758 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:58.722921 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:58.723483 (+ 562us) server_negotiation.cc:299] Negotiation successful
0807 06:58:58.723665 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11734,"thread_start_us":11546,"threads_started":1}
I20260807 06:58:58.725873 1265 tablet_service.cc:1467] Processing CreateTablet for tablet f058b640ee1a41049c7395dc0093043d (DEFAULT_TABLE table=test-table [id=72549c37ae874e13b15f96df651b9948]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:58.727322 1265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f058b640ee1a41049c7395dc0093043d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:58.728703 1450 tablet_service.cc:1467] Processing CreateTablet for tablet f058b640ee1a41049c7395dc0093043d (DEFAULT_TABLE table=test-table [id=72549c37ae874e13b15f96df651b9948]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:58:58.730103 1450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f058b640ee1a41049c7395dc0093043d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:58:58.735962 1582 tablet_bootstrap.cc:492] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: Bootstrap starting.
I20260807 06:58:58.739111 1582 tablet_bootstrap.cc:654] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:58.740444 1582 log.cc:824] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:58.744752 1584 tablet_bootstrap.cc:492] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: Bootstrap starting.
I20260807 06:58:58.747326 1582 tablet_bootstrap.cc:492] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: No bootstrap required, opened a new log
I20260807 06:58:58.747596 1582 ts_tablet_manager.cc:1397] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260807 06:58:58.749792 1585 tablet_bootstrap.cc:492] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: Bootstrap starting.
I20260807 06:58:58.750691 1584 tablet_bootstrap.cc:654] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:58.751991 1584 log.cc:824] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:58.753400 1585 tablet_bootstrap.cc:654] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: Neither blocks nor log segments found. Creating new log.
I20260807 06:58:58.754370 1585 log.cc:824] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:58:58.755167 1584 tablet_bootstrap.cc:492] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: No bootstrap required, opened a new log
I20260807 06:58:58.755429 1584 ts_tablet_manager.cc:1397] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260807 06:58:58.757035 1585 tablet_bootstrap.cc:492] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: No bootstrap required, opened a new log
I20260807 06:58:58.757339 1585 ts_tablet_manager.cc:1397] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260807 06:58:58.758184 1582 raft_consensus.cc:348] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:58.758603 1582 raft_consensus.cc:374] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:58.758745 1582 raft_consensus.cc:729] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0058be4b2d4024876ce14f06eb705b, State: Initialized, Role: FOLLOWER
I20260807 06:58:58.759397 1582 consensus_queue.cc:260] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:58.762503 1582 ts_tablet_manager.cc:1428] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260807 06:58:58.765394 1584 raft_consensus.cc:348] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:58.765846 1584 raft_consensus.cc:374] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:58.765959 1584 raft_consensus.cc:729] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 748b3d240da54dc794e423b3b2353879, State: Initialized, Role: FOLLOWER
I20260807 06:58:58.766641 1584 consensus_queue.cc:260] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:58.766659 1585 raft_consensus.cc:348] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:58.767131 1585 raft_consensus.cc:374] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:58:58.767257 1585 raft_consensus.cc:729] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631459c1af0640a1ab60de1f3e304f9a, State: Initialized, Role: FOLLOWER
I20260807 06:58:58.767886 1358 heartbeater.cc:503] Master 127.10.191.190:45771 was elected leader, sending a full tablet report...
I20260807 06:58:58.767889 1585 consensus_queue.cc:260] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:58.768350 1584 ts_tablet_manager.cc:1428] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260807 06:58:58.768989 1554 heartbeater.cc:503] Master 127.10.191.190:45771 was elected leader, sending a full tablet report...
I20260807 06:58:58.769671 1585 ts_tablet_manager.cc:1428] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
W20260807 06:58:58.797261 1176 tablet.cc:2369] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:58:58.848937 1359 tablet.cc:2369] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:58:58.879506 1555 tablet.cc:2369] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:58:59.090641 1591 raft_consensus.cc:482] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:58:59.091001 1591 raft_consensus.cc:504] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:59.092720 1591 leader_election.cc:288] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a0058be4b2d4024876ce14f06eb705b (127.10.191.129:40355), 631459c1af0640a1ab60de1f3e304f9a (127.10.191.131:45689)
I20260807 06:58:59.097894 1592 raft_consensus.cc:482] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:58:59.098282 1592 raft_consensus.cc:504] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:59.101271 1592 leader_election.cc:288] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a0058be4b2d4024876ce14f06eb705b (127.10.191.129:40355), 748b3d240da54dc794e423b3b2353879 (127.10.191.130:42053)
I20260807 06:58:59.102133 1581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.093240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:45539 (local address 127.10.191.131:45689)
0807 06:58:59.093448 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:59.093456 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:59.094291 (+ 835us) server_negotiation.cc:407] Connection header received
0807 06:58:59.094507 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:59.094512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:59.094592 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:59.094700 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:59.096142 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.096954 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.099593 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.100838 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.100954 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.101041 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:59.101749 (+ 708us) server_negotiation.cc:299] Negotiation successful
0807 06:58:59.101883 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 06:58:59.102947 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.093244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:45689 (local address 127.10.191.130:45539)
0807 06:58:59.094188 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:59.094205 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:59.094341 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:59.094751 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:59.094756 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:59.095532 (+ 776us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:59.095931 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:59.095944 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.097124 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.097130 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:59.099389 (+ 2259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:59.099404 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.101298 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.101305 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:59.101509 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.101569 (+ 60us) client_negotiation.cc:769] Sending connection context
0807 06:58:59.102345 (+ 776us) client_negotiation.cc:240] Negotiation successful
0807 06:58:59.102484 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"mutex_wait_us":33,"spinlock_wait_cycles":4864,"thread_start_us":456,"threads_started":1}
I20260807 06:58:59.103931 1479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f058b640ee1a41049c7395dc0093043d" candidate_uuid: "748b3d240da54dc794e423b3b2353879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631459c1af0640a1ab60de1f3e304f9a" is_pre_election: true
I20260807 06:58:59.104286 1574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.093307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:56457 (local address 127.10.191.129:40355)
0807 06:58:59.093501 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:59.093509 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:59.094291 (+ 782us) server_negotiation.cc:407] Connection header received
0807 06:58:59.094543 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:59.094547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:59.094634 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:59.094727 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:59.095484 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.096324 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.099260 (+ 2936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.100512 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.100640 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.100710 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:59.103915 (+ 3205us) server_negotiation.cc:299] Negotiation successful
0807 06:58:59.104047 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 06:58:59.104388 1479 raft_consensus.cc:2454] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 748b3d240da54dc794e423b3b2353879 in term 0.
I20260807 06:58:59.104986 1594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.093134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:40355 (local address 127.10.191.130:56457)
0807 06:58:59.094143 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:59.094177 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:59.094383 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:59.094751 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:59.094756 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:59.094803 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:59.095308 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:59.095324 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.096458 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.096463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:59.099064 (+ 2601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:59.099081 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.100936 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.100945 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:59.103701 (+ 2756us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.103756 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 06:58:59.104474 (+ 718us) client_negotiation.cc:240] Negotiation successful
0807 06:58:59.104602 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"mutex_wait_us":46,"spinlock_wait_cycles":37504,"thread_start_us":587,"threads_started":1}
I20260807 06:58:59.105430 1203 leader_election.cc:302] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631459c1af0640a1ab60de1f3e304f9a, 748b3d240da54dc794e423b3b2353879; no voters:
I20260807 06:58:59.105845 1591 raft_consensus.cc:2781] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:58:59.105973 1591 raft_consensus.cc:482] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:58:59.106069 1591 raft_consensus.cc:3037] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:59.105985 1102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f058b640ee1a41049c7395dc0093043d" candidate_uuid: "748b3d240da54dc794e423b3b2353879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a0058be4b2d4024876ce14f06eb705b" is_pre_election: true
I20260807 06:58:59.106505 1102 raft_consensus.cc:2454] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 748b3d240da54dc794e423b3b2353879 in term 0.
I20260807 06:58:59.109449 1591 raft_consensus.cc:504] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:59.110610 1102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f058b640ee1a41049c7395dc0093043d" candidate_uuid: "748b3d240da54dc794e423b3b2353879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a0058be4b2d4024876ce14f06eb705b"
I20260807 06:58:59.110805 1102 raft_consensus.cc:3037] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:59.111043 1579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.101943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:40743 (local address 127.10.191.130:42053)
0807 06:58:59.102131 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:59.102137 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:59.103895 (+ 1758us) server_negotiation.cc:407] Connection header received
0807 06:58:59.104165 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:59.104171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:59.104244 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:59.104305 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:59.105055 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.106141 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.108492 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.109829 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.109971 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.110047 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:59.110687 (+ 640us) server_negotiation.cc:299] Negotiation successful
0807 06:58:59.110814 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 06:58:59.111491 1591 leader_election.cc:288] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [CANDIDATE]: Term 1 election: Requested vote from peers 2a0058be4b2d4024876ce14f06eb705b (127.10.191.129:40355), 631459c1af0640a1ab60de1f3e304f9a (127.10.191.131:45689)
I20260807 06:58:59.111792 1596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.101586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:42053 (local address 127.10.191.131:40743)
0807 06:58:59.103785 (+ 2199us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:59.103805 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:59.103995 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:59.104492 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:59.104496 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:59.104524 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:59.104885 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:59.104896 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.106345 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.106353 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:59.108307 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:59.108324 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.110254 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.110260 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:59.110466 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.110504 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 06:58:59.111206 (+ 702us) client_negotiation.cc:240] Negotiation successful
0807 06:58:59.111359 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2056,"mutex_wait_us":1,"thread_start_us":1846,"threads_started":1}
I20260807 06:58:59.112713 1296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f058b640ee1a41049c7395dc0093043d" candidate_uuid: "631459c1af0640a1ab60de1f3e304f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "748b3d240da54dc794e423b3b2353879" is_pre_election: true
I20260807 06:58:59.113255 1296 raft_consensus.cc:2379] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631459c1af0640a1ab60de1f3e304f9a in current term 1: Already voted for candidate 748b3d240da54dc794e423b3b2353879 in this term.
I20260807 06:58:59.114408 1557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.100562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:40355 (local address 127.10.191.131:47717)
0807 06:58:59.100810 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 06:58:59.100829 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 06:58:59.100938 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:58:59.102256 (+ 1318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:58:59.102260 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:58:59.102289 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:58:59.102468 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:59.102478 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.108908 (+ 6430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.108914 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:59.110856 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:58:59.110870 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.113678 (+ 2808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.113684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:58:59.113893 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.113934 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 06:58:59.113999 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 06:58:59.114120 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":5}
I20260807 06:58:59.114588 1102 raft_consensus.cc:2454] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748b3d240da54dc794e423b3b2353879 in term 1.
I20260807 06:58:59.114931 1479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f058b640ee1a41049c7395dc0093043d" candidate_uuid: "748b3d240da54dc794e423b3b2353879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631459c1af0640a1ab60de1f3e304f9a"
I20260807 06:58:59.115152 1479 raft_consensus.cc:3037] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:58:59.115479 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.100635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:47717 (local address 127.10.191.129:40355)
0807 06:58:59.101918 (+ 1283us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:59.101924 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:59.101947 (+ 23us) server_negotiation.cc:407] Connection header received
0807 06:58:59.102002 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:59.102007 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:59.102085 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:59.102830 (+ 745us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:58:59.107594 (+ 4764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.108751 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.111122 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.113500 (+ 2378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.114929 (+ 1429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.114996 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:59.115043 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 06:58:59.115158 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1161,"thread_start_us":892,"threads_started":1}
I20260807 06:58:59.116170 1102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f058b640ee1a41049c7395dc0093043d" candidate_uuid: "631459c1af0640a1ab60de1f3e304f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a0058be4b2d4024876ce14f06eb705b" is_pre_election: true
I20260807 06:58:59.116214 1201 leader_election.cc:302] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a0058be4b2d4024876ce14f06eb705b, 748b3d240da54dc794e423b3b2353879; no voters:
I20260807 06:58:59.116448 1102 raft_consensus.cc:2379] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631459c1af0640a1ab60de1f3e304f9a in current term 1: Already voted for candidate 748b3d240da54dc794e423b3b2353879 in this term.
I20260807 06:58:59.116510 1591 raft_consensus.cc:2781] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:58:59.117079 1591 raft_consensus.cc:686] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 1 LEADER]: Becoming Leader. State: Replica: 748b3d240da54dc794e423b3b2353879, State: Running, Role: LEADER
I20260807 06:58:59.117188 1385 leader_election.cc:302] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631459c1af0640a1ab60de1f3e304f9a; no voters: 2a0058be4b2d4024876ce14f06eb705b, 748b3d240da54dc794e423b3b2353879
I20260807 06:58:59.117630 1591 consensus_queue.cc:237] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } }
I20260807 06:58:59.118258 1479 raft_consensus.cc:2454] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748b3d240da54dc794e423b3b2353879 in term 1.
I20260807 06:58:59.118655 1592 raft_consensus.cc:2726] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 06:58:59.122241 879 catalog_manager.cc:5495] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 reported cstate change: term changed from 0 to 1, leader changed from <none> to 748b3d240da54dc794e423b3b2353879 (127.10.191.130). New cstate: current_term: 1 leader_uuid: "748b3d240da54dc794e423b3b2353879" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } health_report { overall_health: UNKNOWN } } }
I20260807 06:58:59.166535 1579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.161185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59950 (local address 127.10.191.130:42053)
0807 06:58:59.161385 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:59.161392 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:59.161494 (+ 102us) server_negotiation.cc:407] Connection header received
0807 06:58:59.161753 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:59.161757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:59.161830 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:59.161979 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:58:59.162348 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.163131 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.164432 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.164788 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.164906 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.165475 (+ 569us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:58:59.165930 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:58:59.166119 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:59.166174 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 06:58:59.166252 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 06:58:59.174396 1102 raft_consensus.cc:1261] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 1 FOLLOWER]: Refusing update from remote peer 748b3d240da54dc794e423b3b2353879: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:59.174476 1479 raft_consensus.cc:1261] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 1 FOLLOWER]: Refusing update from remote peer 748b3d240da54dc794e423b3b2353879: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:58:59.175283 1597 consensus_queue.cc:1035] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:59.175598 1591 consensus_queue.cc:1035] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:58:59.186954 1600 mvcc.cc:205] Tried to move back new op lower bound from 7315808006848606208 to 7315808006630080512. Current Snapshot: MvccSnapshot[applied={T|T < 7315808006848606208}]
I20260807 06:58:59.205205 875 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:58:59.205457 875 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:58:59.208945 875 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Sending DeleteTablet for 3 replicas of tablet f058b640ee1a41049c7395dc0093043d
I20260807 06:58:59.210122 1072 tablet_service.cc:1514] Processing DeleteTablet for tablet f058b640ee1a41049c7395dc0093043d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:59 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:35022
I20260807 06:58:59.210148 1265 tablet_service.cc:1514] Processing DeleteTablet for tablet f058b640ee1a41049c7395dc0093043d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:59 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:59936
I20260807 06:58:59.210419 1450 tablet_service.cc:1514] Processing DeleteTablet for tablet f058b640ee1a41049c7395dc0093043d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:58:59 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:43034
I20260807 06:58:59.210610 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 973
I20260807 06:58:59.220635 1619 tablet_replica.cc:330] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: stopping tablet replica
I20260807 06:58:59.221410 1619 raft_consensus.cc:2229] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:58:59.222177 1619 raft_consensus.cc:2258] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:59.223150 1617 tablet_replica.cc:330] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: stopping tablet replica
I20260807 06:58:59.223862 1617 raft_consensus.cc:2229] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:58:59.225901 1619 ts_tablet_manager.cc:1905] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:59.226613 1617 raft_consensus.cc:2258] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:59.229430 1618 tablet_replica.cc:330] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: stopping tablet replica
I20260807 06:58:59.230614 1617 ts_tablet_manager.cc:1905] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:59.231120 1618 raft_consensus.cc:2229] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:58:59.231855 1618 raft_consensus.cc:2258] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:58:59.236394 1619 ts_tablet_manager.cc:1918] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 07 06:58:59 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 06:58:59.236634 1619 log.cc:1196] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/f058b640ee1a41049c7395dc0093043d
I20260807 06:58:59.237370 1619 ts_tablet_manager.cc:1939] T f058b640ee1a41049c7395dc0093043d P 631459c1af0640a1ab60de1f3e304f9a: Deleting consensus metadata
I20260807 06:58:59.237461 1617 ts_tablet_manager.cc:1918] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:59.237661 1617 log.cc:1196] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/f058b640ee1a41049c7395dc0093043d
I20260807 06:58:59.238279 1617 ts_tablet_manager.cc:1939] T f058b640ee1a41049c7395dc0093043d P 2a0058be4b2d4024876ce14f06eb705b: Deleting consensus metadata
I20260807 06:58:59.238603 1618 ts_tablet_manager.cc:1905] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:58:59.239678 856 catalog_manager.cc:4841] TS 631459c1af0640a1ab60de1f3e304f9a (127.10.191.131:45689): tablet f058b640ee1a41049c7395dc0093043d (table test-table [id=72549c37ae874e13b15f96df651b9948]) successfully deleted
I20260807 06:58:59.239993 852 catalog_manager.cc:4841] TS 2a0058be4b2d4024876ce14f06eb705b (127.10.191.129:40355): tablet f058b640ee1a41049c7395dc0093043d (table test-table [id=72549c37ae874e13b15f96df651b9948]) successfully deleted
I20260807 06:58:59.246189 1618 ts_tablet_manager.cc:1918] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:58:59.246456 1618 log.cc:1196] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/f058b640ee1a41049c7395dc0093043d
I20260807 06:58:59.247042 1618 ts_tablet_manager.cc:1939] T f058b640ee1a41049c7395dc0093043d P 748b3d240da54dc794e423b3b2353879: Deleting consensus metadata
I20260807 06:58:59.248800 1595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.211946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35034 (local address 127.10.191.129:40355)
0807 06:58:59.212139 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:59.212149 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:59.224839 (+ 12690us) server_negotiation.cc:407] Connection header received
0807 06:58:59.225393 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:59.225400 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:59.225492 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:59.225574 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:59.227820 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.228939 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.231558 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.232190 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.232285 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.241612 (+ 9327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:59.241627 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:59.241646 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:59.241696 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:59.245513 (+ 3817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:59.246370 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:59.246379 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:59.246382 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:59.246582 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:59.247034 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:59.247041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:59.247043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:59.247534 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:59.247841 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:59.248199 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 06:58:59.248429 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 06:58:59.248760 853 catalog_manager.cc:4841] TS 748b3d240da54dc794e423b3b2353879 (127.10.191.130:42053): tablet f058b640ee1a41049c7395dc0093043d (table test-table [id=72549c37ae874e13b15f96df651b9948]) successfully deleted
I20260807 06:58:59.249524 1166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:59.366864 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 973
I20260807 06:58:59.403131 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 1182
Aug 07 06:58:59 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 06:58:59.420434 1579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.403883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59954 (local address 127.10.191.130:42053)
0807 06:58:59.404101 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:59.404108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:59.404409 (+ 301us) server_negotiation.cc:407] Connection header received
0807 06:58:59.404520 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:59.404528 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:59.404634 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:59.404765 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:59.406665 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.407442 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.408822 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.409390 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.409532 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.414111 (+ 4579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:59.414125 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:59.414140 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:59.414178 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:59.417324 (+ 3146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:59.418071 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:59.418079 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:59.418081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:59.418222 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:59.418666 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:59.418672 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:59.418676 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:59.419080 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:59.419459 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:59.419791 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 06:58:59.420026 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 06:58:59.421316 1351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:59.537147 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 1182
I20260807 06:58:59.564049 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 1364
Aug 07 06:58:59 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 06:58:59.578768 1581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:58:59.564737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43038 (local address 127.10.191.131:45689)
0807 06:58:59.564900 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 06:58:59.564903 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 06:58:59.564920 (+ 17us) server_negotiation.cc:407] Connection header received
0807 06:58:59.565057 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:58:59.565097 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:58:59.565171 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:58:59.565253 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:58:59.566570 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.567268 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.568478 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:58:59.568847 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:58:59.568939 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:58:59.573417 (+ 4478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:58:59.573431 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:58:59.573446 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:58:59.573502 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:58:59.576331 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:59.576982 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:59.576989 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:59.576991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:59.577190 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:58:59.577501 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:58:59.577505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:58:59.577506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:58:59.577853 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:58:59.578067 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 06:58:59.578335 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 06:58:59.578480 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 06:58:59.579412 1545 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:59.671262 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 1364
I20260807 06:58:59.696098 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 827
I20260807 06:58:59.697387 926 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:58:59.808349 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 827
I20260807 06:59:19.839736 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:45771
--webserver_interface=127.10.191.190
--webserver_port=43919
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:45771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:59:20.193915 1626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:59:20.194211 1626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:59:20.194368 1626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:59:20.201333 1626 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 06:59:20.201416 1626 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 06:59:20.201508 1626 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 06:59:20.201598 1626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:59:20.201706 1626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:59:20.201824 1626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:59:20.201905 1626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:59:20.201982 1626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:59:20.211345 1626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:45771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:45771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=43919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:59:20.212754 1626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:59:20.214216 1626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:59:20.241353 1635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:20.241403 1636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:20.241353 1639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:59:20.246492 1626 server_base.cc:1034] running on GCE node
I20260807 06:59:20.247380 1626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:59:20.249022 1626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:59:20.250342 1626 hybrid_clock.cc:648] HybridClock initialized: now 1786085960250265 us; error 47 us; skew 500 ppm
I20260807 06:59:20.250751 1626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:59:20 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085960, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:59:20.254464 1626 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:59:20.256197 1626 webserver.cc:460] Webserver started at http://127.10.191.190:43919/ using document root <none> and password file <none>
I20260807 06:59:20.257136 1626 fs_manager.cc:359] Metadata directory not provided
I20260807 06:59:20.257301 1626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:59:20.263594 1626 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 06:59:20.267426 1652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:20.268867 1626 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 06:59:20.269021 1626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "624028a3f9df4ddb9784922fe36650b5"
format_stamp: "Formatted at 2026-08-07 06:58:56 on dist-test-slave-tfpf"
server_key: "13972f01a31550e8aa38d380b867d3e9"
server_key_iv: "23f65b6fd2849e2bc834fa91cdabf108"
server_key_version: "encryptionkey@0"
I20260807 06:59:20.270100 1626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:59:20.291669 1626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:59:20.295964 1626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:59:20.296236 1626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:59:20.316035 1626 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:45771
I20260807 06:59:20.316072 1718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:45771 every 8 connection(s)
I20260807 06:59:20.317658 1626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:59:20.324757 1719 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:59:20.325870 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 1626
I20260807 06:59:20.326922 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:40355
--local_ip_for_outbound_sockets=127.10.191.129
--tserver_master_addrs=127.10.191.190:45771
--webserver_port=33663
--webserver_interface=127.10.191.129
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:59:20.329811 1719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Bootstrap starting.
I20260807 06:59:20.353606 1719 log.cc:824] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:59:20.366065 1719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:59:20.366616 1719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Bootstrap complete.
I20260807 06:59:20.375654 1719 raft_consensus.cc:348] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:59:20.376461 1719 raft_consensus.cc:729] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624028a3f9df4ddb9784922fe36650b5, State: Initialized, Role: FOLLOWER
I20260807 06:59:20.377216 1719 consensus_queue.cc:260] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:59:20.377470 1719 raft_consensus.cc:388] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:59:20.377597 1719 raft_consensus.cc:482] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:59:20.377785 1719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 1 FOLLOWER]: Advancing to term 2
I20260807 06:59:20.381516 1719 raft_consensus.cc:504] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:59:20.382076 1719 leader_election.cc:302] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 624028a3f9df4ddb9784922fe36650b5; no voters:
I20260807 06:59:20.382740 1719 leader_election.cc:288] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 06:59:20.382879 1724 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 06:59:20.384155 1724 raft_consensus.cc:686] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 2 LEADER]: Becoming Leader. State: Replica: 624028a3f9df4ddb9784922fe36650b5, State: Running, Role: LEADER
I20260807 06:59:20.384786 1724 consensus_queue.cc:237] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:59:20.385152 1719 sys_catalog.cc:564] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:59:20.387559 1730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 624028a3f9df4ddb9784922fe36650b5. Latest consensus state: current_term: 2 leader_uuid: "624028a3f9df4ddb9784922fe36650b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } } }
I20260807 06:59:20.388031 1730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:59:20.397256 1728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "624028a3f9df4ddb9784922fe36650b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } } }
I20260807 06:59:20.397703 1728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:59:20.398237 1734 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:59:20.406443 1734 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:59:20.407827 1734 catalog_manager.cc:1259] Loaded cluster ID: e4151cfbbef540e2b89c92390e7b5189
I20260807 06:59:20.407990 1734 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:59:20.411821 1734 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:59:20.413825 1734 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Loaded TSK: 0
I20260807 06:59:20.446519 1750 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 06:59:20.462705 1734 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Generated new TSK 1
I20260807 06:59:20.463140 1734 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 06:59:20.705914 1721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:59:20.706274 1721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:59:20.706456 1721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:59:20.714099 1721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:59:20.714238 1721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:59:20.714419 1721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:59:20.724330 1721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:40355
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=33663
--tserver_master_addrs=127.10.191.190:45771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:59:20.725800 1721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:59:20.727147 1721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:59:20.741918 1765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:20.742221 1768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:20.742614 1762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:59:20.742928 1721 server_base.cc:1034] running on GCE node
I20260807 06:59:20.743582 1721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:59:20.744628 1721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:59:20.745852 1721 hybrid_clock.cc:648] HybridClock initialized: now 1786085960745802 us; error 44 us; skew 500 ppm
I20260807 06:59:20.746186 1721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:59:20 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085960, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:59:20.749569 1721 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:59:20.751377 1721 webserver.cc:460] Webserver started at http://127.10.191.129:33663/ using document root <none> and password file <none>
I20260807 06:59:20.752110 1721 fs_manager.cc:359] Metadata directory not provided
I20260807 06:59:20.752283 1721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:59:20.758117 1721 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 06:59:20.761025 1778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:20.762718 1721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:59:20.762910 1721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "2a0058be4b2d4024876ce14f06eb705b"
format_stamp: "Formatted at 2026-08-07 06:58:57 on dist-test-slave-tfpf"
server_key: "fb77aaf884dd265cb7b9e37279a76074"
server_key_iv: "2e7267821e6c8cc5de96b6e7544f1a79"
server_key_version: "encryptionkey@0"
I20260807 06:59:20.763929 1721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:59:20.782791 1721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:59:20.786984 1721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:59:20.787262 1721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:59:20.788255 1721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:59:20.789757 1721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:59:20.789880 1721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:20.790035 1721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:59:20.790132 1721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:20.825182 1721 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:40355
I20260807 06:59:20.825242 1941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:40355 every 8 connection(s)
I20260807 06:59:20.826633 1721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:59:20.832010 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 1721
I20260807 06:59:20.832842 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:42053
--local_ip_for_outbound_sockets=127.10.191.130
--tserver_master_addrs=127.10.191.190:45771
--webserver_port=42789
--webserver_interface=127.10.191.130
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:59:20 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085960, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:59:20.852972 1946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:20.829559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:47117 (local address 127.10.191.190:45771)
0807 06:59:20.830197 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:20.830210 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:20.830768 (+ 558us) server_negotiation.cc:407] Connection header received
0807 06:59:20.833766 (+ 2998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:20.833779 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:20.834107 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:20.834395 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:20.836415 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:20.837797 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:20.840378 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:20.841041 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:20.841243 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:20.845605 (+ 4362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:20.845612 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:20.845626 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:20.845663 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:20.848430 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:20.849225 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:20.849232 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:20.849237 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:20.849407 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:20.849865 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:20.849869 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:20.849871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:20.850310 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:20.850525 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:20.851301 (+ 776us) server_negotiation.cc:299] Negotiation successful
0807 06:59:20.851679 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":299,"threads_started":1}
I20260807 06:59:20.852986 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:20.829761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:47117)
0807 06:59:20.830579 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:20.830634 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 06:59:20.833202 (+ 2568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:59:20.834623 (+ 1421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:59:20.834636 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:59:20.835448 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:59:20.836218 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:20.836244 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:20.837997 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:20.838012 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:20.840146 (+ 2134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:20.840165 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:20.841338 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:20.841348 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:20.841652 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:20.842411 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:59:20.842451 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:59:20.845321 (+ 2870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:59:20.848595 (+ 3274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:59:20.848604 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:59:20.848618 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:59:20.849059 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:59:20.849527 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:59:20.849532 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:59:20.849536 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:59:20.849731 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:59:20.850456 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:59:20.850466 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:59:20.850805 (+ 339us) client_negotiation.cc:769] Sending connection context
0807 06:59:20.851074 (+ 269us) client_negotiation.cc:240] Negotiation successful
0807 06:59:20.851603 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":360,"threads_started":1}
I20260807 06:59:20.856303 1943 heartbeater.cc:347] Connected to a master server at 127.10.191.190:45771
I20260807 06:59:20.856614 1943 heartbeater.cc:464] Registering TS with master...
I20260807 06:59:20.857455 1943 heartbeater.cc:511] Master 127.10.191.190:45771 requested a full tablet report, sending...
I20260807 06:59:20.860000 1671 ts_manager.cc:194] Registered new tserver with Master: 2a0058be4b2d4024876ce14f06eb705b (127.10.191.129:40355)
I20260807 06:59:20.862336 1671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:47117
W20260807 06:59:21.179771 1948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:59:21.180094 1948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:59:21.180233 1948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:59:21.188377 1948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:59:21.188477 1948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:59:21.188580 1948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:59:21.197647 1948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:42053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=42789
--tserver_master_addrs=127.10.191.190:45771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:59:21.198807 1948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:59:21.200114 1948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:59:21.213230 1954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:21.213136 1958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:21.213191 1955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:59:21.214047 1948 server_base.cc:1034] running on GCE node
I20260807 06:59:21.214707 1948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:59:21.215590 1948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:59:21.216811 1948 hybrid_clock.cc:648] HybridClock initialized: now 1786085961216747 us; error 61 us; skew 500 ppm
I20260807 06:59:21.217175 1948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:59:21 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085961, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:59:21.220376 1948 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:59:21.221764 1948 webserver.cc:460] Webserver started at http://127.10.191.130:42789/ using document root <none> and password file <none>
I20260807 06:59:21.222420 1948 fs_manager.cc:359] Metadata directory not provided
I20260807 06:59:21.222538 1948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:59:21.227730 1948 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:59:21.230355 1966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:21.231683 1948 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:59:21.231819 1948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "748b3d240da54dc794e423b3b2353879"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "52d62db5a6dabe644eecc89b6ce7340f"
server_key_iv: "910f030943f7fb7034a54af846d2b681"
server_key_version: "encryptionkey@0"
I20260807 06:59:21.232772 1948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:59:21.255028 1948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:59:21.259104 1948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:59:21.259338 1948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:59:21.260270 1948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:59:21.261771 1948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:59:21.261909 1948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:21.262032 1948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:59:21.262141 1948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:21.295969 1948 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:42053
I20260807 06:59:21.296063 2121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:42053 every 8 connection(s)
I20260807 06:59:21.297706 1948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:59:21.307538 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 1948
I20260807 06:59:21.308305 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:45689
--local_ip_for_outbound_sockets=127.10.191.131
--tserver_master_addrs=127.10.191.190:45771
--webserver_port=34103
--webserver_interface=127.10.191.131
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 06:59:21 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085961, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:59:21.318833 1946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.300335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:43447 (local address 127.10.191.190:45771)
0807 06:59:21.300519 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:21.300523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:21.302093 (+ 1570us) server_negotiation.cc:407] Connection header received
0807 06:59:21.303874 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:21.303879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:21.303946 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:21.304065 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:21.305668 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.306388 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.307805 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.308428 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.308578 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.312424 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:21.312429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:21.312432 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:21.312463 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:21.315096 (+ 2633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:21.316073 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:21.316081 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:21.316086 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:21.316236 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:21.316768 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:21.316773 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:21.316776 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:21.317170 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:21.317326 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:21.318243 (+ 917us) server_negotiation.cc:299] Negotiation successful
0807 06:59:21.318473 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 06:59:21.319986 2124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.300945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:43447)
0807 06:59:21.301898 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:21.301947 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 06:59:21.303624 (+ 1677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:59:21.304284 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:59:21.304291 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:59:21.304797 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:59:21.305518 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.305537 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.306526 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.306529 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.307630 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.307641 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.308689 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.308694 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.308868 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.309583 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:59:21.309609 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:59:21.312186 (+ 2577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:59:21.315236 (+ 3050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:59:21.315247 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:59:21.315264 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:59:21.315929 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:59:21.316366 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:59:21.316373 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:59:21.316379 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:59:21.316616 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:59:21.317311 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:59:21.317322 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:59:21.317750 (+ 428us) client_negotiation.cc:769] Sending connection context
0807 06:59:21.318075 (+ 325us) client_negotiation.cc:240] Negotiation successful
0807 06:59:21.318646 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":411,"threads_started":1}
I20260807 06:59:21.321419 2122 heartbeater.cc:347] Connected to a master server at 127.10.191.190:45771
I20260807 06:59:21.321733 2122 heartbeater.cc:464] Registering TS with master...
I20260807 06:59:21.322546 2122 heartbeater.cc:511] Master 127.10.191.190:45771 requested a full tablet report, sending...
I20260807 06:59:21.323947 1671 ts_manager.cc:194] Registered new tserver with Master: 748b3d240da54dc794e423b3b2353879 (127.10.191.130:42053)
I20260807 06:59:21.324714 1671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:43447
W20260807 06:59:21.658767 2125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:59:21.659027 2125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:59:21.659235 2125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:59:21.666366 2125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:59:21.666496 2125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:59:21.666692 2125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:59:21.676196 2125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:45689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=34103
--tserver_master_addrs=127.10.191.190:45771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:59:21.677454 2125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:59:21.678774 2125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:59:21.691787 2130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:21.691818 2132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:21.692556 2134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:59:21.693034 2125 server_base.cc:1034] running on GCE node
I20260807 06:59:21.693704 2125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:59:21.694633 2125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:59:21.695889 2125 hybrid_clock.cc:648] HybridClock initialized: now 1786085961695807 us; error 43 us; skew 500 ppm
I20260807 06:59:21.696213 2125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:59:21 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085961, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:59:21.699505 2125 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:59:21.700857 2125 webserver.cc:460] Webserver started at http://127.10.191.131:34103/ using document root <none> and password file <none>
I20260807 06:59:21.701627 2125 fs_manager.cc:359] Metadata directory not provided
I20260807 06:59:21.701788 2125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:59:21.707022 2125 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 06:59:21.709417 2146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:21.710532 2125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 06:59:21.710688 2125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "631459c1af0640a1ab60de1f3e304f9a"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "ae415f0494d036a985076e752b80e7bc"
server_key_iv: "d2334eebffcbe78cb432beee2cad40c6"
server_key_version: "encryptionkey@0"
I20260807 06:59:21.711673 2125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:59:21.734405 2125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:59:21.738925 2125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:59:21.739231 2125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:59:21.740216 2125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:59:21.741720 2125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:59:21.741864 2125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:21.742002 2125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:59:21.742089 2125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:21.776494 2125 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:45689
I20260807 06:59:21.776577 2307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:45689 every 8 connection(s)
I20260807 06:59:21.778090 2125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:59:21.788314 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 2125
Aug 07 06:59:21 dist-test-slave-tfpf krb5kdc[809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085961, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 06:59:21.804391 1946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.780580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:52251 (local address 127.10.191.190:45771)
0807 06:59:21.780805 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:21.780811 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:21.781993 (+ 1182us) server_negotiation.cc:407] Connection header received
0807 06:59:21.783804 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:21.783809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:21.783875 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:21.783967 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:21.785427 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.786242 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.787874 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.788276 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.788358 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.793408 (+ 5050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:21.793414 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:21.793418 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:21.793461 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:21.800704 (+ 7243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:21.801729 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:21.801734 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:21.801738 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:21.801920 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:21.802402 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:21.802410 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:21.802416 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:21.802779 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:21.802992 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:21.803723 (+ 731us) server_negotiation.cc:299] Negotiation successful
0807 06:59:21.804012 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 06:59:21.805486 2313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.781133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:52251)
0807 06:59:21.781829 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:21.781866 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 06:59:21.783525 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:59:21.784178 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:59:21.784185 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:59:21.784649 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0807 06:59:21.785267 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.785286 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.786384 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.786388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.787746 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.787758 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.788495 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.788504 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.788787 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.789524 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 06:59:21.789561 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 06:59:21.793173 (+ 3612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 06:59:21.800849 (+ 7676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:59:21.800855 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:59:21.800884 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:59:21.801563 (+ 679us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:59:21.802030 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 06:59:21.802035 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 06:59:21.802038 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 06:59:21.802284 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 06:59:21.802926 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 06:59:21.802934 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 06:59:21.803294 (+ 360us) client_negotiation.cc:769] Sending connection context
0807 06:59:21.803602 (+ 308us) client_negotiation.cc:240] Negotiation successful
0807 06:59:21.804091 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":253,"threads_started":1}
I20260807 06:59:21.807497 2309 heartbeater.cc:347] Connected to a master server at 127.10.191.190:45771
I20260807 06:59:21.807817 2309 heartbeater.cc:464] Registering TS with master...
I20260807 06:59:21.808352 2314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.789304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52734 (local address 127.10.191.190:45771)
0807 06:59:21.789856 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:21.789864 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:21.790394 (+ 530us) server_negotiation.cc:407] Connection header received
0807 06:59:21.790514 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:21.790519 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:21.790609 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:21.790723 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:21.792279 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.793521 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.795636 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.796698 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.796888 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.800458 (+ 3570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:21.800464 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:21.800469 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:21.800505 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:21.804543 (+ 4038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:21.805533 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:21.805540 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:21.805545 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:21.805704 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:21.806223 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:21.806228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:21.806233 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:21.806651 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:21.806968 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:21.807385 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 06:59:21.807604 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":252,"threads_started":1}
I20260807 06:59:21.808657 2309 heartbeater.cc:511] Master 127.10.191.190:45771 requested a full tablet report, sending...
I20260807 06:59:21.810374 1670 ts_manager.cc:194] Registered new tserver with Master: 631459c1af0640a1ab60de1f3e304f9a (127.10.191.131:45689)
I20260807 06:59:21.811825 1670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:52251
I20260807 06:59:21.825723 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 06:59:21.834851 2314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.826924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52740 (local address 127.10.191.190:45771)
0807 06:59:21.827178 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:21.827186 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:21.827914 (+ 728us) server_negotiation.cc:407] Connection header received
0807 06:59:21.828210 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:21.828215 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:21.828410 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:21.828593 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:59:21.829281 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.830341 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.832821 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.833355 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.833463 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.834110 (+ 647us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:59:21.834364 (+ 254us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 06:59:21.834627 (+ 263us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52740: token expired
Metrics: {"server-negotiator.queue_time_us":82}
W20260807 06:59:21.834992 2314 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52740: token expired
W20260807 06:59:21.835814 1560 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.191.190:45771)
I20260807 06:59:21.851301 2314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.836492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52744 (local address 127.10.191.190:45771)
0807 06:59:21.836742 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:21.836750 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:21.836770 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:59:21.836823 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:21.836830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:21.836907 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:21.837012 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:21.838491 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.839773 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.841048 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.841871 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.842017 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.844764 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:21.844773 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:21.844780 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:21.844824 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:21.848422 (+ 3598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:21.849126 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:21.849134 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:21.849140 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:21.849315 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:21.849668 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:21.849675 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:21.849680 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:21.850173 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:21.850444 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:21.850631 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 06:59:21.850877 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 06:59:21.855294 1670 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 06:59:21.863160 1670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 06:59:21.865720 1943 heartbeater.cc:503] Master 127.10.191.190:45771 was elected leader, sending a full tablet report...
I20260807 06:59:21.902644 2330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.879508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47460 (local address 127.10.191.130:42053)
0807 06:59:21.893989 (+ 14481us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:21.893998 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:21.894025 (+ 27us) server_negotiation.cc:407] Connection header received
0807 06:59:21.894125 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:21.894130 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:21.894345 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:21.894547 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:59:21.895246 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.896926 (+ 1680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.899667 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.901240 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.901406 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.901596 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:21.902108 (+ 512us) server_negotiation.cc:299] Negotiation successful
0807 06:59:21.902327 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14298,"thread_start_us":14192,"threads_started":1}
I20260807 06:59:21.902777 2329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.879344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:42053 (local address 127.0.0.1:47460)
0807 06:59:21.893447 (+ 14103us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:21.893471 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 06:59:21.893606 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:59:21.894539 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:59:21.894544 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:59:21.894570 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:59:21.894976 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.894989 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.897131 (+ 2142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.897138 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.899451 (+ 2313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.899470 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.901523 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.901531 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.901809 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.901876 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 06:59:21.902029 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 06:59:21.902301 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13941,"thread_start_us":11731,"threads_started":1}
I20260807 06:59:21.904515 2325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.876323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:45689 (local address 127.0.0.1:44950)
0807 06:59:21.886397 (+ 10074us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:21.886449 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 06:59:21.886667 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:59:21.896010 (+ 9343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:59:21.896015 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:59:21.896038 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:59:21.896467 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.896479 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.898763 (+ 2284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.898771 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.901536 (+ 2765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.901552 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.903451 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.903460 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.903708 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.903762 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 06:59:21.903870 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 06:59:21.904082 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9847,"mutex_wait_us":46,"thread_start_us":16096,"threads_started":1}
I20260807 06:59:21.904776 2326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.877188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44950 (local address 127.10.191.131:45689)
0807 06:59:21.895203 (+ 18015us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:21.895213 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:21.895245 (+ 32us) server_negotiation.cc:407] Connection header received
0807 06:59:21.895352 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:21.895358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:21.895567 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:21.896654 (+ 1087us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:59:21.897013 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.898613 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.901741 (+ 3128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.903163 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.903369 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.903552 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:21.903990 (+ 438us) server_negotiation.cc:299] Negotiation successful
0807 06:59:21.904407 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17821,"thread_start_us":18554,"threads_started":1}
I20260807 06:59:21.907120 2034 tablet_service.cc:1467] Processing CreateTablet for tablet 85043b599faf45a8b253ee1a81f256b7 (DEFAULT_TABLE table=test-table [id=6959c57f916a429d815a2d5a3723b9d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:59:21.908597 2034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85043b599faf45a8b253ee1a81f256b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:59:21.908869 2214 tablet_service.cc:1467] Processing CreateTablet for tablet 85043b599faf45a8b253ee1a81f256b7 (DEFAULT_TABLE table=test-table [id=6959c57f916a429d815a2d5a3723b9d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:59:21.910898 2324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.876657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33996 (local address 127.10.191.129:40355)
0807 06:59:21.884818 (+ 8161us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:21.884830 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:21.892919 (+ 8089us) server_negotiation.cc:407] Connection header received
0807 06:59:21.893244 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:21.893258 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:21.893617 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:21.893839 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:59:21.896099 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.897996 (+ 1897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.907989 (+ 9993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.909486 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.909703 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.909864 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:21.910416 (+ 552us) server_negotiation.cc:299] Negotiation successful
0807 06:59:21.910588 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7947,"thread_start_us":7794,"threads_started":1}
I20260807 06:59:21.911688 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:21.876324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:40355 (local address 127.0.0.1:33996)
0807 06:59:21.892732 (+ 16408us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:21.892770 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 06:59:21.892922 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:59:21.894043 (+ 1121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:59:21.894053 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:59:21.894087 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:59:21.894617 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.895882 (+ 1265us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.898209 (+ 2327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.898216 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.907781 (+ 9565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:21.907798 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:21.910025 (+ 2227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:21.910031 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:21.910208 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:21.910238 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 06:59:21.911138 (+ 900us) client_negotiation.cc:240] Negotiation successful
0807 06:59:21.911287 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16258,"mutex_wait_us":816,"thread_start_us":8818,"threads_started":1}
I20260807 06:59:21.911787 2214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85043b599faf45a8b253ee1a81f256b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:59:21.914602 1851 tablet_service.cc:1467] Processing CreateTablet for tablet 85043b599faf45a8b253ee1a81f256b7 (DEFAULT_TABLE table=test-table [id=6959c57f916a429d815a2d5a3723b9d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 06:59:21.915973 1851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85043b599faf45a8b253ee1a81f256b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 06:59:21.933668 2331 tablet_bootstrap.cc:492] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: Bootstrap starting.
I20260807 06:59:21.934697 2332 tablet_bootstrap.cc:492] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: Bootstrap starting.
I20260807 06:59:21.938989 2331 tablet_bootstrap.cc:654] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: Neither blocks nor log segments found. Creating new log.
I20260807 06:59:21.938984 2332 tablet_bootstrap.cc:654] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: Neither blocks nor log segments found. Creating new log.
I20260807 06:59:21.940330 2331 log.cc:824] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: Log is configured to *not* fsync() on all Append() calls
I20260807 06:59:21.940330 2332 log.cc:824] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: Log is configured to *not* fsync() on all Append() calls
I20260807 06:59:21.942993 2333 tablet_bootstrap.cc:492] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: Bootstrap starting.
I20260807 06:59:21.948946 2333 tablet_bootstrap.cc:654] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: Neither blocks nor log segments found. Creating new log.
I20260807 06:59:21.949893 2332 tablet_bootstrap.cc:492] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: No bootstrap required, opened a new log
I20260807 06:59:21.949895 2331 tablet_bootstrap.cc:492] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: No bootstrap required, opened a new log
I20260807 06:59:21.950206 2331 ts_tablet_manager.cc:1397] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.006s
I20260807 06:59:21.950232 2332 ts_tablet_manager.cc:1397] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
I20260807 06:59:21.953045 2333 log.cc:824] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: Log is configured to *not* fsync() on all Append() calls
I20260807 06:59:21.961354 2331 raft_consensus.cc:348] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } }
I20260807 06:59:21.961869 2331 raft_consensus.cc:374] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:59:21.962000 2331 raft_consensus.cc:729] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 748b3d240da54dc794e423b3b2353879, State: Initialized, Role: FOLLOWER
I20260807 06:59:21.962581 2332 raft_consensus.cc:348] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } }
I20260807 06:59:21.962805 2331 consensus_queue.cc:260] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } }
I20260807 06:59:21.963157 2332 raft_consensus.cc:374] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:59:21.963310 2332 raft_consensus.cc:729] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0058be4b2d4024876ce14f06eb705b, State: Initialized, Role: FOLLOWER
I20260807 06:59:21.964169 2332 consensus_queue.cc:260] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } }
I20260807 06:59:21.970067 2332 ts_tablet_manager.cc:1428] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: Time spent starting tablet: real 0.020s user 0.013s sys 0.004s
I20260807 06:59:21.970532 2333 tablet_bootstrap.cc:492] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: No bootstrap required, opened a new log
I20260807 06:59:21.970918 2333 ts_tablet_manager.cc:1397] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: Time spent bootstrapping tablet: real 0.028s user 0.014s sys 0.008s
I20260807 06:59:21.979481 2122 heartbeater.cc:503] Master 127.10.191.190:45771 was elected leader, sending a full tablet report...
I20260807 06:59:21.979979 2331 ts_tablet_manager.cc:1428] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: Time spent starting tablet: real 0.030s user 0.027s sys 0.001s
I20260807 06:59:21.982831 2333 raft_consensus.cc:348] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } }
I20260807 06:59:21.983356 2333 raft_consensus.cc:374] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 06:59:21.983556 2333 raft_consensus.cc:729] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631459c1af0640a1ab60de1f3e304f9a, State: Initialized, Role: FOLLOWER
I20260807 06:59:21.984164 2333 consensus_queue.cc:260] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } }
I20260807 06:59:21.985347 2309 heartbeater.cc:503] Master 127.10.191.190:45771 was elected leader, sending a full tablet report...
I20260807 06:59:21.986699 2333 ts_tablet_manager.cc:1428] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260807 06:59:22.029829 2311 tablet.cc:2369] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:59:22.050122 2123 tablet.cc:2369] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 06:59:22.079015 1945 tablet.cc:2369] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 06:59:22.155736 2338 raft_consensus.cc:482] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 06:59:22.156193 2338 raft_consensus.cc:504] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } }
I20260807 06:59:22.158735 2338 leader_election.cc:288] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 631459c1af0640a1ab60de1f3e304f9a (127.10.191.131:45689), 2a0058be4b2d4024876ce14f06eb705b (127.10.191.129:40355)
I20260807 06:59:22.167290 2324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:22.159687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:43781 (local address 127.10.191.129:40355)
0807 06:59:22.159889 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:22.159896 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:22.160524 (+ 628us) server_negotiation.cc:407] Connection header received
0807 06:59:22.160913 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:22.160921 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:22.161009 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:22.161124 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:59:22.161860 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.163180 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.165518 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.166309 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.166496 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:22.166575 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:22.166868 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 06:59:22.167000 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 06:59:22.167501 2344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:22.159014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:40355 (local address 127.10.191.130:43781)
0807 06:59:22.160369 (+ 1355us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:22.160396 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 06:59:22.160681 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:59:22.161138 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:59:22.161143 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:59:22.161175 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:59:22.161681 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:22.161693 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.163330 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.163336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:22.165376 (+ 2040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:22.165387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.166530 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.166537 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:22.166711 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:22.166735 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 06:59:22.166839 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 06:59:22.167024 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1168,"mutex_wait_us":22,"thread_start_us":1318,"threads_started":1}
I20260807 06:59:22.168653 2326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:22.159437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:35045 (local address 127.10.191.131:45689)
0807 06:59:22.159645 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:22.159651 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:22.160739 (+ 1088us) server_negotiation.cc:407] Connection header received
0807 06:59:22.161021 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:22.161029 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:22.161153 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:22.161262 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 06:59:22.161978 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.162824 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.165393 (+ 2569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.166976 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.167185 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:22.167309 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:22.168102 (+ 793us) server_negotiation.cc:299] Negotiation successful
0807 06:59:22.168273 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 06:59:22.168817 1881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85043b599faf45a8b253ee1a81f256b7" candidate_uuid: "748b3d240da54dc794e423b3b2353879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a0058be4b2d4024876ce14f06eb705b" is_pre_election: true
I20260807 06:59:22.169485 1881 raft_consensus.cc:2454] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 748b3d240da54dc794e423b3b2353879 in term 0.
I20260807 06:59:22.169695 2343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:22.159064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:45689 (local address 127.10.191.130:35045)
0807 06:59:22.160622 (+ 1558us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:22.160636 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 06:59:22.160783 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 06:59:22.161321 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 06:59:22.161325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 06:59:22.161351 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 06:59:22.161837 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:22.161846 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.162958 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.162964 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:22.165203 (+ 2239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 06:59:22.165221 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.167577 (+ 2356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.167586 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 06:59:22.167842 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:22.167911 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 06:59:22.168931 (+ 1020us) client_negotiation.cc:240] Negotiation successful
0807 06:59:22.169150 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1466,"mutex_wait_us":20,"thread_start_us":868,"threads_started":1}
I20260807 06:59:22.170212 1971 leader_election.cc:302] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a0058be4b2d4024876ce14f06eb705b, 748b3d240da54dc794e423b3b2353879; no voters:
I20260807 06:59:22.170658 2338 raft_consensus.cc:2781] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 06:59:22.170837 2338 raft_consensus.cc:482] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 06:59:22.170977 2338 raft_consensus.cc:3037] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:59:22.170948 2241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85043b599faf45a8b253ee1a81f256b7" candidate_uuid: "748b3d240da54dc794e423b3b2353879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631459c1af0640a1ab60de1f3e304f9a" is_pre_election: true
I20260807 06:59:22.171515 2241 raft_consensus.cc:2454] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 748b3d240da54dc794e423b3b2353879 in term 0.
I20260807 06:59:22.174738 2338 raft_consensus.cc:504] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } }
I20260807 06:59:22.175663 2338 leader_election.cc:288] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [CANDIDATE]: Term 1 election: Requested vote from peers 631459c1af0640a1ab60de1f3e304f9a (127.10.191.131:45689), 2a0058be4b2d4024876ce14f06eb705b (127.10.191.129:40355)
I20260807 06:59:22.175988 2241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85043b599faf45a8b253ee1a81f256b7" candidate_uuid: "748b3d240da54dc794e423b3b2353879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631459c1af0640a1ab60de1f3e304f9a"
I20260807 06:59:22.176177 2241 raft_consensus.cc:3037] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:59:22.176287 1881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85043b599faf45a8b253ee1a81f256b7" candidate_uuid: "748b3d240da54dc794e423b3b2353879" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a0058be4b2d4024876ce14f06eb705b"
I20260807 06:59:22.176505 1881 raft_consensus.cc:3037] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [term 0 FOLLOWER]: Advancing to term 1
I20260807 06:59:22.178773 1881 raft_consensus.cc:2454] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748b3d240da54dc794e423b3b2353879 in term 1.
I20260807 06:59:22.179141 1971 leader_election.cc:302] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a0058be4b2d4024876ce14f06eb705b, 748b3d240da54dc794e423b3b2353879; no voters:
I20260807 06:59:22.179414 2338 raft_consensus.cc:2781] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 06:59:22.179690 2241 raft_consensus.cc:2454] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 748b3d240da54dc794e423b3b2353879 in term 1.
I20260807 06:59:22.179986 2338 raft_consensus.cc:686] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 1 LEADER]: Becoming Leader. State: Replica: 748b3d240da54dc794e423b3b2353879, State: Running, Role: LEADER
I20260807 06:59:22.180459 2338 consensus_queue.cc:237] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } }
I20260807 06:59:22.185282 1671 catalog_manager.cc:5495] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 reported cstate change: term changed from 0 to 1, leader changed from <none> to 748b3d240da54dc794e423b3b2353879 (127.10.191.130). New cstate: current_term: 1 leader_uuid: "748b3d240da54dc794e423b3b2353879" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "748b3d240da54dc794e423b3b2353879" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42053 } health_report { overall_health: HEALTHY } } }
I20260807 06:59:22.266186 2330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:22.260718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47474 (local address 127.10.191.130:42053)
0807 06:59:22.260920 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:22.260927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:22.261012 (+ 85us) server_negotiation.cc:407] Connection header received
0807 06:59:22.261297 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:22.261302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:22.261387 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:22.261556 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 06:59:22.261962 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.262695 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.264027 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.264433 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.264568 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:22.265053 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 06:59:22.265634 (+ 581us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 06:59:22.265796 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:22.265849 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 06:59:22.265922 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 06:59:22.275202 2241 raft_consensus.cc:1261] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [term 1 FOLLOWER]: Refusing update from remote peer 748b3d240da54dc794e423b3b2353879: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:59:22.275242 1881 raft_consensus.cc:1261] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [term 1 FOLLOWER]: Refusing update from remote peer 748b3d240da54dc794e423b3b2353879: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 06:59:22.276212 2338 consensus_queue.cc:1035] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a0058be4b2d4024876ce14f06eb705b" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 40355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:59:22.276499 2345 consensus_queue.cc:1035] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631459c1af0640a1ab60de1f3e304f9a" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 06:59:22.287353 2348 mvcc.cc:205] Tried to move back new op lower bound from 7315808101469155328 to 7315808101095002112. Current Snapshot: MvccSnapshot[applied={T|T < 7315808101469155328}]
I20260807 06:59:22.291514 2350 mvcc.cc:205] Tried to move back new op lower bound from 7315808101469155328 to 7315808101095002112. Current Snapshot: MvccSnapshot[applied={T|T < 7315808101469155328}]
I20260807 06:59:22.305974 1671 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:59:22.306339 1671 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 06:59:22.311550 1671 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Sending DeleteTablet for 3 replicas of tablet 85043b599faf45a8b253ee1a81f256b7
I20260807 06:59:22.312847 2214 tablet_service.cc:1514] Processing DeleteTablet for tablet 85043b599faf45a8b253ee1a81f256b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:59:22 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:44950
I20260807 06:59:22.313486 2034 tablet_service.cc:1514] Processing DeleteTablet for tablet 85043b599faf45a8b253ee1a81f256b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:59:22 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:47460
I20260807 06:59:22.314014 1851 tablet_service.cc:1514] Processing DeleteTablet for tablet 85043b599faf45a8b253ee1a81f256b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 06:59:22 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:33996
I20260807 06:59:22.314874 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 1721
I20260807 06:59:22.341114 2368 tablet_replica.cc:330] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: stopping tablet replica
I20260807 06:59:22.341610 2368 raft_consensus.cc:2229] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 1 LEADER]: Raft consensus shutting down.
I20260807 06:59:22.342317 2368 raft_consensus.cc:2258] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:59:22.344714 2369 tablet_replica.cc:330] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: stopping tablet replica
I20260807 06:59:22.345172 2369 raft_consensus.cc:2229] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:59:22.345510 2367 tablet_replica.cc:330] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: stopping tablet replica
I20260807 06:59:22.345721 2369 raft_consensus.cc:2258] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:59:22.345918 2367 raft_consensus.cc:2229] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 06:59:22.346390 2367 raft_consensus.cc:2258] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 06:59:22.351053 2367 ts_tablet_manager.cc:1905] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:59:22.353824 2369 ts_tablet_manager.cc:1905] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:59:22.358274 2367 ts_tablet_manager.cc:1918] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:59:22.358470 2367 log.cc:1196] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/85043b599faf45a8b253ee1a81f256b7
I20260807 06:59:22.358989 2367 ts_tablet_manager.cc:1939] T 85043b599faf45a8b253ee1a81f256b7 P 631459c1af0640a1ab60de1f3e304f9a: Deleting consensus metadata
I20260807 06:59:22.361621 2369 ts_tablet_manager.cc:1918] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:59:22.361779 2369 log.cc:1196] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/85043b599faf45a8b253ee1a81f256b7
I20260807 06:59:22.361928 1656 catalog_manager.cc:4841] TS 631459c1af0640a1ab60de1f3e304f9a (127.10.191.131:45689): tablet 85043b599faf45a8b253ee1a81f256b7 (table test-table [id=6959c57f916a429d815a2d5a3723b9d3]) successfully deleted
I20260807 06:59:22.362316 2369 ts_tablet_manager.cc:1939] T 85043b599faf45a8b253ee1a81f256b7 P 2a0058be4b2d4024876ce14f06eb705b: Deleting consensus metadata
I20260807 06:59:22.363821 2368 ts_tablet_manager.cc:1905] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 06:59:22.364120 1654 catalog_manager.cc:4841] TS 2a0058be4b2d4024876ce14f06eb705b (127.10.191.129:40355): tablet 85043b599faf45a8b253ee1a81f256b7 (table test-table [id=6959c57f916a429d815a2d5a3723b9d3]) successfully deleted
I20260807 06:59:22.366134 2324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:22.316260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34012 (local address 127.10.191.129:40355)
0807 06:59:22.316621 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:22.316628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:22.338917 (+ 22289us) server_negotiation.cc:407] Connection header received
0807 06:59:22.339402 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:22.339408 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:22.339493 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:22.339578 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:22.341773 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.342966 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.346816 (+ 3850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.347472 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.347576 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:22.358404 (+ 10828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:22.358420 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:22.358437 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:22.358542 (+ 105us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:22.362717 (+ 4175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:22.363713 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:22.363722 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:22.363728 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:22.363884 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:22.364347 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:22.364352 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:22.364354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:22.364734 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:22.364950 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:22.365491 (+ 541us) server_negotiation.cc:299] Negotiation successful
0807 06:59:22.365754 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164}
I20260807 06:59:22.366799 1937 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:59:22.371615 2368 ts_tablet_manager.cc:1918] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 06:59:22.371788 2368 log.cc:1196] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/85043b599faf45a8b253ee1a81f256b7
I20260807 06:59:22.372381 2368 ts_tablet_manager.cc:1939] T 85043b599faf45a8b253ee1a81f256b7 P 748b3d240da54dc794e423b3b2353879: Deleting consensus metadata
I20260807 06:59:22.374485 1655 catalog_manager.cc:4841] TS 748b3d240da54dc794e423b3b2353879 (127.10.191.130:42053): tablet 85043b599faf45a8b253ee1a81f256b7 (table test-table [id=6959c57f916a429d815a2d5a3723b9d3]) successfully deleted
I20260807 06:59:22.455148 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 1721
I20260807 06:59:22.482892 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 1948
I20260807 06:59:22.499090 2330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:22.483814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47480 (local address 127.10.191.130:42053)
0807 06:59:22.484013 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:22.484019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:22.484039 (+ 20us) server_negotiation.cc:407] Connection header received
0807 06:59:22.484163 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:22.484176 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:22.484253 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:22.484354 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:22.485853 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.487126 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.488554 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.489314 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.489435 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:22.492157 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:22.492185 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:22.492204 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:22.492278 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:22.496069 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:22.496842 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:22.496852 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:22.496855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:22.497026 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:22.497456 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:22.497461 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:22.497464 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:22.497930 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:22.498284 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:22.498463 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 06:59:22.498688 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 06:59:22.499984 2116 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:59:22.612641 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 1948
I20260807 06:59:22.639822 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 2125
I20260807 06:59:22.652990 2326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:22.640597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44958 (local address 127.10.191.131:45689)
0807 06:59:22.640786 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:22.640790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:22.640808 (+ 18us) server_negotiation.cc:407] Connection header received
0807 06:59:22.640915 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:22.640919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:22.641000 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:22.641137 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:22.642467 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.643187 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.644322 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:22.644665 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:22.644754 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:22.647872 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:22.647884 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:22.647898 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:22.647932 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:22.650475 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:22.651217 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:22.651223 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:22.651225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:22.651347 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:22.651644 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:22.651647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:22.651648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:22.651979 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:22.652185 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:22.652450 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 06:59:22.652602 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 06:59:22.653887 2300 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:59:22.737051 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 2125
I20260807 06:59:22.761768 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 1626
I20260807 06:59:22.763072 1712 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:59:22.873754 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 1626
I20260807 06:59:42.912048 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:45771
--webserver_interface=127.10.191.190
--webserver_port=43919
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:45771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 06:59:43.254828 2375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:59:43.255090 2375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:59:43.255177 2375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:59:43.262410 2375 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 06:59:43.262506 2375 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 06:59:43.262542 2375 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 06:59:43.262601 2375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 06:59:43.262655 2375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:59:43.262730 2375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:59:43.262826 2375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 06:59:43.262903 2375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 06:59:43.272255 2375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:45771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:45771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=43919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:59:43.273504 2375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:59:43.274801 2375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:59:43.286931 2385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:43.286991 2381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:43.287016 2380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:59:43.287266 2375 server_base.cc:1034] running on GCE node
I20260807 06:59:43.288335 2375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:59:43.289767 2375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:59:43.291008 2375 hybrid_clock.cc:648] HybridClock initialized: now 1786085983290942 us; error 56 us; skew 500 ppm
I20260807 06:59:43.291340 2375 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:59:43 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085983, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:59:43.297901 2375 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 06:59:43.299341 2375 webserver.cc:460] Webserver started at http://127.10.191.190:43919/ using document root <none> and password file <none>
I20260807 06:59:43.300046 2375 fs_manager.cc:359] Metadata directory not provided
I20260807 06:59:43.300189 2375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:59:43.305570 2375 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:59:43.308245 2393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:43.309546 2375 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:59:43.309724 2375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "624028a3f9df4ddb9784922fe36650b5"
format_stamp: "Formatted at 2026-08-07 06:58:56 on dist-test-slave-tfpf"
server_key: "13972f01a31550e8aa38d380b867d3e9"
server_key_iv: "23f65b6fd2849e2bc834fa91cdabf108"
server_key_version: "encryptionkey@0"
I20260807 06:59:43.310611 2375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:59:43.335932 2375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:59:43.339852 2375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:59:43.340157 2375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:59:43.358690 2375 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:45771
I20260807 06:59:43.358731 2461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:45771 every 8 connection(s)
I20260807 06:59:43.360136 2375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 06:59:43.364701 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 2375
I20260807 06:59:43.365587 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:40355
--local_ip_for_outbound_sockets=127.10.191.129
--tserver_master_addrs=127.10.191.190:45771
--webserver_port=33663
--webserver_interface=127.10.191.129
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:59:43.367038 2463 sys_catalog.cc:263] Verifying existing consensus state
I20260807 06:59:43.370323 2463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Bootstrap starting.
I20260807 06:59:43.390179 2463 log.cc:824] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Log is configured to *not* fsync() on all Append() calls
I20260807 06:59:43.405627 2463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 06:59:43.406119 2463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Bootstrap complete.
I20260807 06:59:43.414892 2463 raft_consensus.cc:348] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:59:43.415860 2463 raft_consensus.cc:729] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 624028a3f9df4ddb9784922fe36650b5, State: Initialized, Role: FOLLOWER
I20260807 06:59:43.416435 2463 consensus_queue.cc:260] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:59:43.416687 2463 raft_consensus.cc:388] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 06:59:43.416844 2463 raft_consensus.cc:482] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 06:59:43.417042 2463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 2 FOLLOWER]: Advancing to term 3
I20260807 06:59:43.420512 2463 raft_consensus.cc:504] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:59:43.421042 2463 leader_election.cc:302] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 624028a3f9df4ddb9784922fe36650b5; no voters:
I20260807 06:59:43.421809 2463 leader_election.cc:288] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 06:59:43.421949 2471 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 06:59:43.423264 2471 raft_consensus.cc:686] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [term 3 LEADER]: Becoming Leader. State: Replica: 624028a3f9df4ddb9784922fe36650b5, State: Running, Role: LEADER
I20260807 06:59:43.423802 2471 consensus_queue.cc:237] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } }
I20260807 06:59:43.424103 2463 sys_catalog.cc:564] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 06:59:43.426723 2472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "624028a3f9df4ddb9784922fe36650b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } } }
I20260807 06:59:43.427106 2472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:59:43.426862 2473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 624028a3f9df4ddb9784922fe36650b5. Latest consensus state: current_term: 3 leader_uuid: "624028a3f9df4ddb9784922fe36650b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "624028a3f9df4ddb9784922fe36650b5" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 45771 } } }
I20260807 06:59:43.427305 2473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5 [sys.catalog]: This master's current role is: LEADER
I20260807 06:59:43.438336 2479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 06:59:43.448305 2479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 06:59:43.450563 2479 catalog_manager.cc:1259] Loaded cluster ID: e4151cfbbef540e2b89c92390e7b5189
I20260807 06:59:43.450958 2479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 06:59:43.456700 2479 catalog_manager.cc:1504] Loading token signing keys...
I20260807 06:59:43.458410 2479 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Loaded TSK: 0
I20260807 06:59:43.458621 2479 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 624028a3f9df4ddb9784922fe36650b5: Loaded TSK: 1
F20260807 06:59:43.459782 2479 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fcde13619ad google::LogMessage::Fail() at ??:0
@ 0x7fcde136488a google::LogMessage::SendToLog() at ??:0
@ 0x7fcde13614de google::LogMessage::Flush() at ??:0
@ 0x7fcde1362a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fcde50c57d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fcde50b473e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fcdf6d901c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fcdf6d8f783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fcdf6e1b2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fcdf6e1b0c4 std::_Function_handler<>::_M_invoke() at ??:0
I20260807 06:59:43.507555 2499 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7fcdf6e655e9 std::function<>::operator()() at ??:0
@ 0x7fcdf6d93cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fcdf6d91c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fcdf6e19610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fcdf6e19439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fcde3fad345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fcde3fb091c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fcde3fb0799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fcde3f8beaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fcde72656db start_thread at ??:0
@ 0x7fcde01fb61f clone at ??:0
W20260807 06:59:43.780150 2468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:59:43.780445 2468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:59:43.780556 2468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:59:43.788097 2468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:59:43.788223 2468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:59:43.788460 2468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 06:59:43.798623 2468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:40355
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=33663
--tserver_master_addrs=127.10.191.190:45771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:59:43.800016 2468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:59:43.801466 2468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:59:43.814868 2536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:43.814919 2540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:43.814950 2538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:59:43.815845 2468 server_base.cc:1034] running on GCE node
I20260807 06:59:43.816517 2468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:59:43.817579 2468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:59:43.818819 2468 hybrid_clock.cc:648] HybridClock initialized: now 1786085983818775 us; error 52 us; skew 500 ppm
I20260807 06:59:43.819164 2468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:59:43 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085983, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:59:43.822471 2468 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 06:59:43.823961 2468 webserver.cc:460] Webserver started at http://127.10.191.129:33663/ using document root <none> and password file <none>
I20260807 06:59:43.824723 2468 fs_manager.cc:359] Metadata directory not provided
I20260807 06:59:43.824883 2468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:59:43.830708 2468 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 06:59:43.833580 2551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:43.834952 2468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:59:43.835151 2468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "2a0058be4b2d4024876ce14f06eb705b"
format_stamp: "Formatted at 2026-08-07 06:58:57 on dist-test-slave-tfpf"
server_key: "fb77aaf884dd265cb7b9e37279a76074"
server_key_iv: "2e7267821e6c8cc5de96b6e7544f1a79"
server_key_version: "encryptionkey@0"
I20260807 06:59:43.836222 2468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:59:43.849483 2468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:59:43.853350 2468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:59:43.853618 2468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:59:43.854599 2468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:59:43.856097 2468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:59:43.856228 2468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:43.856349 2468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:59:43.856436 2468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:43.891832 2468 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:40355
I20260807 06:59:43.891939 2711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:40355 every 8 connection(s)
I20260807 06:59:43.893430 2468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 06:59:43.898295 2714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:43.896425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:33929)
0807 06:59:43.897211 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:43.897447 (+ 236us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":292,"threads_started":1}
W20260807 06:59:43.898922 2712 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:45771 (0 consecutive failures): Network error: Failed to ping master at 127.10.191.190:45771: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
I20260807 06:59:43.899711 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 2468
I20260807 06:59:43.899787 2714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:43.899472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:40065)
0807 06:59:43.899620 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:43.899686 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 06:59:43.900537 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:42053
--local_ip_for_outbound_sockets=127.10.191.130
--tserver_master_addrs=127.10.191.190:45771
--webserver_port=42789
--webserver_interface=127.10.191.130
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:59:43.900678 2714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:43.900331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:38587)
0807 06:59:43.900458 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:43.900529 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 06:59:43.900878 2712 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:59:44.249380 2715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:59:44.249655 2715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:59:44.249749 2715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:59:44.256893 2715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:59:44.257022 2715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:59:44.257228 2715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 06:59:44.266394 2715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:42053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=42789
--tserver_master_addrs=127.10.191.190:45771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:59:44.267566 2715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:59:44.268788 2715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:59:44.283090 2723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:44.283044 2725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:44.283136 2729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:59:44.284324 2715 server_base.cc:1034] running on GCE node
I20260807 06:59:44.285015 2715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:59:44.286031 2715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:59:44.287269 2715 hybrid_clock.cc:648] HybridClock initialized: now 1786085984287217 us; error 42 us; skew 500 ppm
I20260807 06:59:44.287596 2715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:59:44 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085984, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:59:44.290887 2715 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 06:59:44.292413 2715 webserver.cc:460] Webserver started at http://127.10.191.130:42789/ using document root <none> and password file <none>
I20260807 06:59:44.293179 2715 fs_manager.cc:359] Metadata directory not provided
I20260807 06:59:44.293329 2715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:59:44.298619 2715 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 06:59:44.301270 2738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:44.302630 2715 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 06:59:44.302809 2715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "748b3d240da54dc794e423b3b2353879"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "52d62db5a6dabe644eecc89b6ce7340f"
server_key_iv: "910f030943f7fb7034a54af846d2b681"
server_key_version: "encryptionkey@0"
I20260807 06:59:44.303774 2715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:59:44.326144 2715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:59:44.330453 2715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:59:44.330745 2715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:59:44.331717 2715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:59:44.332998 2715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:59:44.333151 2715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 06:59:44.333271 2715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:59:44.333353 2715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:44.365909 2715 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:42053
I20260807 06:59:44.366020 2899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:42053 every 8 connection(s)
I20260807 06:59:44.367421 2715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 06:59:44.372172 2908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:44.370291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:35593)
0807 06:59:44.371073 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:44.371365 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":277,"threads_started":1}
W20260807 06:59:44.372931 2905 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:45771 (0 consecutive failures): Network error: Failed to ping master at 127.10.191.190:45771: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
I20260807 06:59:44.373176 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 2715
I20260807 06:59:44.373803 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:45689
--local_ip_for_outbound_sockets=127.10.191.131
--tserver_master_addrs=127.10.191.190:45771
--webserver_port=34103
--webserver_interface=127.10.191.131
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 06:59:44.373840 2908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:44.373505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:43753)
0807 06:59:44.373668 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:44.373743 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 06:59:44.374866 2908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:44.374398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:39089)
0807 06:59:44.374579 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:44.374696 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 06:59:44.375159 2905 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 06:59:44.720999 2909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 06:59:44.721356 2909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 06:59:44.721558 2909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 06:59:44.728621 2909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 06:59:44.728796 2909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 06:59:44.728978 2909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 06:59:44.738492 2909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:45689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=34103
--tserver_master_addrs=127.10.191.190:45771
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 06:59:44.739677 2909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 06:59:44.740934 2909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 06:59:44.753597 2917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:44.753785 2915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 06:59:44.753597 2919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 06:59:44.755354 2909 server_base.cc:1034] running on GCE node
I20260807 06:59:44.755923 2909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 06:59:44.756906 2909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 06:59:44.758219 2909 hybrid_clock.cc:648] HybridClock initialized: now 1786085984758175 us; error 79 us; skew 500 ppm
I20260807 06:59:44.758555 2909 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 06:59:44 dist-test-slave-tfpf krb5kdc[809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786085984, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 06:59:44.761926 2909 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 06:59:44.763427 2909 webserver.cc:460] Webserver started at http://127.10.191.131:34103/ using document root <none> and password file <none>
I20260807 06:59:44.764137 2909 fs_manager.cc:359] Metadata directory not provided
I20260807 06:59:44.764245 2909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 06:59:44.769402 2909 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260807 06:59:44.772030 2928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:44.773317 2909 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 06:59:44.773487 2909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "631459c1af0640a1ab60de1f3e304f9a"
format_stamp: "Formatted at 2026-08-07 06:58:58 on dist-test-slave-tfpf"
server_key: "ae415f0494d036a985076e752b80e7bc"
server_key_iv: "d2334eebffcbe78cb432beee2cad40c6"
server_key_version: "encryptionkey@0"
I20260807 06:59:44.774401 2909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 06:59:44.790490 2909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 06:59:44.793995 2909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 06:59:44.794281 2909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 06:59:44.795279 2909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 06:59:44.796476 2909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 06:59:44.796605 2909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:44.796764 2909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 06:59:44.796856 2909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 06:59:44.830128 2909 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:45689
I20260807 06:59:44.830214 3094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:45689 every 8 connection(s)
I20260807 06:59:44.831559 2909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 06:59:44.836275 3099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:44.834503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:47421)
0807 06:59:44.835214 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:44.835457 (+ 243us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":266,"threads_started":1}
I20260807 06:59:44.836519 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 2909
W20260807 06:59:44.837020 3096 heartbeater.cc:644] Failed to heartbeat to 127.10.191.190:45771 (0 consecutive failures): Network error: Failed to ping master at 127.10.191.190:45771: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
I20260807 06:59:44.838030 3099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:44.837591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:41513)
0807 06:59:44.837771 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:44.837875 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 06:59:44.839095 3099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:44.838797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:43913)
0807 06:59:44.838919 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:44.838990 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 06:59:44.839377 3096 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 06:59:44.902207 3102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:44.901528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:49051)
0807 06:59:44.901912 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:44.902007 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":189,"threads_started":1}
I20260807 06:59:45.376502 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:45.375670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:56221)
0807 06:59:45.376092 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:45.376207 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":217,"threads_started":1}
I20260807 06:59:45.840740 3104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:45.839854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:48021)
0807 06:59:45.840405 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:45.840514 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":327,"threads_started":1}
I20260807 06:59:45.903932 3106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:45.903153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:39575)
0807 06:59:45.903680 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:45.903762 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":245,"threads_started":1}
I20260807 06:59:46.378226 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:46.377483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:49199)
0807 06:59:46.378005 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:46.378076 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":258,"threads_started":1}
I20260807 06:59:46.842201 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:46.841540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:48317)
0807 06:59:46.841933 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:46.842033 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":204,"threads_started":1}
I20260807 06:59:46.905542 3110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:46.904801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:38635)
0807 06:59:46.905293 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:46.905374 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":218,"threads_started":1}
I20260807 06:59:47.379855 3111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:47.379089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:59089)
0807 06:59:47.379602 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:47.379680 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":294,"threads_started":1}
I20260807 06:59:47.843729 3112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:47.843050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:33109)
0807 06:59:47.843477 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:47.843554 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":225,"threads_started":1}
I20260807 06:59:47.907370 3113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:47.906478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:58735)
0807 06:59:47.907006 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:47.907100 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":286,"threads_started":1}
I20260807 06:59:48.381349 3114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:48.380630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:36617)
0807 06:59:48.381032 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:48.381165 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":193,"threads_started":1}
I20260807 06:59:48.845553 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:48.844832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:42681)
0807 06:59:48.845298 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:48.845373 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":268,"threads_started":1}
I20260807 06:59:48.909039 3117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:48.908294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:51937)
0807 06:59:48.908790 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:48.908870 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":278,"threads_started":1}
I20260807 06:59:49.382778 3118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:49.382125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:48905)
0807 06:59:49.382544 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:49.382616 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":208,"threads_started":1}
I20260807 06:59:49.847134 3119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:49.846497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:55787)
0807 06:59:49.846905 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:49.846977 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":215,"threads_started":1}
I20260807 06:59:49.910553 3120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:49.909913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:41183)
0807 06:59:49.910319 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:49.910403 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":209,"threads_started":1}
I20260807 06:59:50.384191 3122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:50.383571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:58031)
0807 06:59:50.383960 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:50.384043 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":204,"threads_started":1}
I20260807 06:59:50.848729 3123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:50.848044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:41955)
0807 06:59:50.848463 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:50.848550 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":219,"threads_started":1}
I20260807 06:59:50.912145 3125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:50.911375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:40385)
0807 06:59:50.911851 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:50.911926 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":207,"threads_started":1}
I20260807 06:59:51.386127 3126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:51.385293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:58617)
0807 06:59:51.385793 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:51.385874 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":232,"threads_started":1}
I20260807 06:59:51.850566 3127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:51.849611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:47049)
0807 06:59:51.850195 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:51.850288 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":263,"threads_started":1}
I20260807 06:59:51.913748 3128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:51.913048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:49237)
0807 06:59:51.913520 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:51.913597 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":217,"threads_started":1}
I20260807 06:59:52.387713 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:52.386986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:52089)
0807 06:59:52.387466 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:52.387547 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":232,"threads_started":1}
I20260807 06:59:52.852289 3131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:52.851626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:57367)
0807 06:59:52.852039 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:52.852115 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":215,"threads_started":1}
I20260807 06:59:52.915470 3133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:52.914636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:40861)
0807 06:59:52.915213 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:52.915297 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":309,"threads_started":1}
I20260807 06:59:53.389353 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:53.388623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:59263)
0807 06:59:53.389080 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:53.389175 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":213,"threads_started":1}
I20260807 06:59:53.853937 3136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:53.853184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:37945)
0807 06:59:53.853680 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:53.853759 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":223,"threads_started":1}
I20260807 06:59:53.917245 3137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:53.916464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:51131)
0807 06:59:53.916932 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:53.917014 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":265,"threads_started":1}
I20260807 06:59:54.390955 3140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:54.390192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:40677)
0807 06:59:54.390621 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:54.390708 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":234,"threads_started":1}
I20260807 06:59:54.855572 3141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:54.854879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:58725)
0807 06:59:54.855334 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:54.855411 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":245,"threads_started":1}
I20260807 06:59:54.918910 3145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:54.918176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:35373)
0807 06:59:54.918629 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:54.918728 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":221,"threads_started":1}
I20260807 06:59:55.392601 3146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:55.391881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:45329)
0807 06:59:55.392358 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:55.392442 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":279,"threads_started":1}
I20260807 06:59:55.857164 3147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:55.856415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:34427)
0807 06:59:55.856847 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:55.856934 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":218,"threads_started":1}
I20260807 06:59:55.920722 3148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:55.919928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:51711)
0807 06:59:55.920477 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:55.920557 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":322,"threads_started":1}
I20260807 06:59:56.394116 3149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:56.393495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:55237)
0807 06:59:56.393893 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:56.393968 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":194,"threads_started":1}
I20260807 06:59:56.858740 3150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:56.858091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:54567)
0807 06:59:56.858503 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:56.858580 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":219,"threads_started":1}
I20260807 06:59:56.922339 3152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:56.921578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:51151)
0807 06:59:56.922055 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:56.922146 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":243,"threads_started":1}
I20260807 06:59:57.395840 3153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:57.395007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:57063)
0807 06:59:57.395570 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:57.395664 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":305,"threads_started":1}
I20260807 06:59:57.860812 3154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:57.859969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:37797)
0807 06:59:57.860499 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:57.860605 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":270,"threads_started":1}
I20260807 06:59:57.924006 3155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:57.923326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:49301)
0807 06:59:57.923757 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:57.923839 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":199,"threads_started":1}
I20260807 06:59:58.397840 3156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:58.396909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:50517)
0807 06:59:58.397534 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:58.397629 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":361,"threads_started":1}
I20260807 06:59:58.862453 3157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:58.861645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:44361)
0807 06:59:58.862174 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:58.862268 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":270,"threads_started":1}
I20260807 06:59:58.925973 3158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:58.925212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.129:51691)
0807 06:59:58.925677 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:58.925781 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":213,"threads_started":1}
I20260807 06:59:59.399505 3163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:59.398849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.130:39175)
0807 06:59:59.399229 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:59.399333 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":195,"threads_started":1}
I20260807 06:59:59.840274 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 2468
I20260807 06:59:59.858345 3165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:59.841426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37754 (local address 127.10.191.129:40355)
0807 06:59:59.841976 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:59.841996 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:59.842050 (+ 54us) server_negotiation.cc:407] Connection header received
0807 06:59:59.843992 (+ 1942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:59.844003 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:59.844455 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:59.844749 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:59.846261 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:59.847492 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:59.848737 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:59.849465 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:59.849598 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:59.852246 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:59.852253 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:59.852267 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:59.852305 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:59.855428 (+ 3123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:59.856068 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:59.856074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:59.856080 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:59.856260 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:59.856575 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:59.856578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:59.856580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:59.857162 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:59.857403 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:59.857725 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 06:59:59.858049 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":266,"threads_started":1}
I20260807 06:59:59.859711 2707 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 06:59:59.864339 3169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:59.863618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:45771 (local address 127.10.191.131:39401)
0807 06:59:59.864071 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 06:59:59.864167 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.190:45771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":225,"threads_started":1}
I20260807 06:59:59.945843 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 2468
I20260807 06:59:59.969527 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 2715
I20260807 06:59:59.987445 3171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 06:59:59.970589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52300 (local address 127.10.191.130:42053)
0807 06:59:59.971169 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0807 06:59:59.971182 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 06:59:59.971221 (+ 39us) server_negotiation.cc:407] Connection header received
0807 06:59:59.972835 (+ 1614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 06:59:59.972846 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 06:59:59.973340 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 06:59:59.973682 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0807 06:59:59.975066 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:59.976288 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:59.977804 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 06:59:59.978503 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 06:59:59.978638 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 06:59:59.981480 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 06:59:59.981488 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 06:59:59.981502 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 06:59:59.981538 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 06:59:59.984300 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:59.985006 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:59.985012 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:59.985019 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:59.985352 (+ 333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 06:59:59.985712 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 06:59:59.985716 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 06:59:59.985718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 06:59:59.986204 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 06:59:59.986439 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 06:59:59.986843 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 06:59:59.987164 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":301,"threads_started":1}
I20260807 06:59:59.989118 2890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:00.072860 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 2715
I20260807 07:00:00.099830 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 2909
I20260807 07:00:00.117303 3173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:00.100810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36586 (local address 127.10.191.131:45689)
0807 07:00:00.101463 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:00.101478 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:00.101519 (+ 41us) server_negotiation.cc:407] Connection header received
0807 07:00:00.103193 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:00.103203 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:00.103608 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:00.103893 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:00.105195 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:00.106479 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:00.107895 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:00.108508 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:00.108634 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:00.111284 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:00.111291 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:00.111304 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:00.111338 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:00.114318 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:00.114916 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:00.114922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:00.114928 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:00.115095 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:00.115424 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:00.115427 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:00.115429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:00.115925 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:00.116147 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:00.116510 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 07:00:00.116940 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":332,"threads_started":1}
I20260807 07:00:00.118664 3087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:00.198782 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 2909
2026-08-07T07:00:00Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65344 ms)
[----------] 30 tests from SecurityITest (304165 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:00 dist-test-slave-tfpf krb5kdc[3179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:00 dist-test-slave-tfpf krb5kdc[3179](info): set up 2 sockets
Aug 07 07:00:00 dist-test-slave-tfpf krb5kdc[3179](info): commencing operation
krb5kdc: starting...
W20260807 07:00:01.459847 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:01 dist-test-slave-tfpf krb5kdc[3179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:00:01.752518 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42115
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:42115
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:02.084707 3195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:02.084970 3195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:02.085059 3195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:02.091625 3195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:02.091723 3195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:02.091773 3195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:02.091828 3195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:02.091889 3195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:02.100788 3195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:42115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:02.101924 3195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:02.103139 3195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:02.114995 3201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:02.114883 3202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:02.114925 3205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:02.115289 3195 server_base.cc:1034] running on GCE node
I20260807 07:00:02.116386 3195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:02.117761 3195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:02.118966 3195 hybrid_clock.cc:648] HybridClock initialized: now 1786086002118903 us; error 48 us; skew 500 ppm
I20260807 07:00:02.119258 3195 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:02 dist-test-slave-tfpf krb5kdc[3179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086002, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:02.122483 3195 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:00:02.123943 3195 webserver.cc:460] Webserver started at http://127.10.191.190:45611/ using document root <none> and password file <none>
I20260807 07:00:02.124611 3195 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:02.124758 3195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:02.125211 3195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:02.128186 3195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "044482062aae43c4abd6d64a7ad3591a"
format_stamp: "Formatted at 2026-08-07 07:00:02 on dist-test-slave-tfpf"
server_key: "f0126c1216ecd4d0767f7ea4f87288b9"
server_key_iv: "8ecd306233afe835ed6e29a327aef0e5"
server_key_version: "encryptionkey@0"
I20260807 07:00:02.128927 3195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "044482062aae43c4abd6d64a7ad3591a"
format_stamp: "Formatted at 2026-08-07 07:00:02 on dist-test-slave-tfpf"
server_key: "f0126c1216ecd4d0767f7ea4f87288b9"
server_key_iv: "8ecd306233afe835ed6e29a327aef0e5"
server_key_version: "encryptionkey@0"
I20260807 07:00:02.133677 3195 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 07:00:02.136957 3213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:02.138243 3195 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 07:00:02.138413 3195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "044482062aae43c4abd6d64a7ad3591a"
format_stamp: "Formatted at 2026-08-07 07:00:02 on dist-test-slave-tfpf"
server_key: "f0126c1216ecd4d0767f7ea4f87288b9"
server_key_iv: "8ecd306233afe835ed6e29a327aef0e5"
server_key_version: "encryptionkey@0"
I20260807 07:00:02.138600 3195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:02.149991 3195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:02.153518 3195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:02.153798 3195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:02.172083 3195 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:42115
I20260807 07:00:02.172107 3287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:42115 every 8 connection(s)
I20260807 07:00:02.173460 3195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:02.177007 3288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:02.177112 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 3195
I20260807 07:00:02.177331 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:02.178033 11006 external_mini_cluster.cc:1428] Setting key da3846383cc6fefa5c55548ed258a293
I20260807 07:00:02.189906 3288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a: Bootstrap starting.
Aug 07 07:00:02 dist-test-slave-tfpf krb5kdc[3179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:02.193428 3288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:02.194429 3288 log.cc:824] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:02.197546 3288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a: No bootstrap required, opened a new log
I20260807 07:00:02.201186 3291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:02.179836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40824 (local address 127.10.191.190:42115)
0807 07:00:02.180553 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:02.180571 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:02.180611 (+ 40us) server_negotiation.cc:407] Connection header received
0807 07:00:02.182583 (+ 1972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:02.182603 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:02.182940 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:02.183228 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:02.184842 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:02.186091 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:02.187922 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:02.188488 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:02.188620 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:02.193216 (+ 4596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:02.193224 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:02.193235 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:02.193267 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:02.196660 (+ 3393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:02.197450 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:02.197459 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:02.197466 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:02.197714 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:02.198103 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:02.198107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:02.198110 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:02.198783 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:02.199091 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:02.199446 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 07:00:02.199883 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":356,"threads_started":1}
I20260807 07:00:02.206697 3288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "044482062aae43c4abd6d64a7ad3591a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42115 } }
I20260807 07:00:02.207050 3288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:02.207139 3288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044482062aae43c4abd6d64a7ad3591a, State: Initialized, Role: FOLLOWER
I20260807 07:00:02.207653 3288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "044482062aae43c4abd6d64a7ad3591a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42115 } }
I20260807 07:00:02.207962 3288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:02.208108 3288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:02.208317 3288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:02.210460 3288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "044482062aae43c4abd6d64a7ad3591a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42115 } }
I20260807 07:00:02.210932 3288 leader_election.cc:302] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 044482062aae43c4abd6d64a7ad3591a; no voters:
I20260807 07:00:02.211577 3288 leader_election.cc:288] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:02.211726 3293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:02.212380 3293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [term 1 LEADER]: Becoming Leader. State: Replica: 044482062aae43c4abd6d64a7ad3591a, State: Running, Role: LEADER
I20260807 07:00:02.212926 3293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "044482062aae43c4abd6d64a7ad3591a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42115 } }
I20260807 07:00:02.213789 3288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:02.215703 3295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 044482062aae43c4abd6d64a7ad3591a. Latest consensus state: current_term: 1 leader_uuid: "044482062aae43c4abd6d64a7ad3591a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "044482062aae43c4abd6d64a7ad3591a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42115 } } }
I20260807 07:00:02.215662 3294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "044482062aae43c4abd6d64a7ad3591a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "044482062aae43c4abd6d64a7ad3591a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42115 } } }
I20260807 07:00:02.216158 3294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:02.217125 3295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:02.219063 3300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:02.223760 3300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:02.232964 3300 catalog_manager.cc:1347] Generated new cluster ID: 57b46f023b824a13a342b1a75ce73f41
I20260807 07:00:02.233135 3300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:02.246851 3300 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:02.248019 3300 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:02.256717 3300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a: Generated new TSK 0
I20260807 07:00:02.257531 3300 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 07:00:02.328733 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42115
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:02.678977 3324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:02.679231 3324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:02.679416 3324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:02.685791 3324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:02.685925 3324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:02.686124 3324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 07:00:02.695168 3324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:02.696411 3324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:02.697818 3324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:02.710167 3337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:02.710207 3334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:02.710467 3331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:02.711282 3324 server_base.cc:1034] running on GCE node
I20260807 07:00:02.711941 3324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:02.712853 3324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:02.714079 3324 hybrid_clock.cc:648] HybridClock initialized: now 1786086002714027 us; error 62 us; skew 500 ppm
I20260807 07:00:02.714381 3324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:02 dist-test-slave-tfpf krb5kdc[3179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086002, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:02.717644 3324 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 07:00:02.718945 3324 webserver.cc:460] Webserver started at http://127.10.191.129:41137/ using document root <none> and password file <none>
I20260807 07:00:02.719565 3324 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:02.719717 3324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:02.720050 3324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:02.722882 3324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "566b14ff7ce04adcb83103d8742068b5"
format_stamp: "Formatted at 2026-08-07 07:00:02 on dist-test-slave-tfpf"
server_key: "5e3fcfda3ab44120d224dfc0b17fcab7"
server_key_iv: "39c698ef63c5bd656a55ca8e3331a4eb"
server_key_version: "encryptionkey@0"
I20260807 07:00:02.723621 3324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "566b14ff7ce04adcb83103d8742068b5"
format_stamp: "Formatted at 2026-08-07 07:00:02 on dist-test-slave-tfpf"
server_key: "5e3fcfda3ab44120d224dfc0b17fcab7"
server_key_iv: "39c698ef63c5bd656a55ca8e3331a4eb"
server_key_version: "encryptionkey@0"
I20260807 07:00:02.728684 3324 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260807 07:00:02.732095 3353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:02.733394 3324 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 07:00:02.733564 3324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "566b14ff7ce04adcb83103d8742068b5"
format_stamp: "Formatted at 2026-08-07 07:00:02 on dist-test-slave-tfpf"
server_key: "5e3fcfda3ab44120d224dfc0b17fcab7"
server_key_iv: "39c698ef63c5bd656a55ca8e3331a4eb"
server_key_version: "encryptionkey@0"
I20260807 07:00:02.733769 3324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:02.761296 3324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:02.764946 3324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:02.765246 3324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:02.766078 3324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:02.767381 3324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:02.767459 3324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:02.767550 3324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:02.767593 3324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:02.799794 3324 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:35103
I20260807 07:00:02.799873 3543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:35103 every 8 connection(s)
I20260807 07:00:02.800951 3324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 07:00:02.807225 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 3324
I20260807 07:00:02.807466 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 07:00:02.808180 11006 external_mini_cluster.cc:1428] Setting key 7415e5f0109e6b0af80ef5ea9b55e09d
Aug 07 07:00:02 dist-test-slave-tfpf krb5kdc[3179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086002, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:02.822362 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:02.803573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:38073 (local address 127.10.191.190:42115)
0807 07:00:02.804057 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:02.804061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:02.804970 (+ 909us) server_negotiation.cc:407] Connection header received
0807 07:00:02.806900 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:02.806906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:02.806993 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:02.807128 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:02.808837 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:02.809644 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:02.811378 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:02.812085 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:02.812244 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:02.815750 (+ 3506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:02.815758 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:02.815765 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:02.815806 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:02.819280 (+ 3474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:02.819944 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:02.819952 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:02.819957 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:02.820121 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:02.820513 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:02.820520 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:02.820525 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:02.820877 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:02.821029 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:02.821688 (+ 659us) server_negotiation.cc:299] Negotiation successful
0807 07:00:02.821923 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":235,"threads_started":1}
I20260807 07:00:02.822897 3549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:02.804145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42115 (local address 127.10.191.129:38073)
0807 07:00:02.804812 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:02.804859 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:02.806606 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:02.807389 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:02.807397 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:02.808021 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:02.808636 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:02.808654 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:02.809814 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:02.809821 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:02.811226 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:02.811239 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:02.812301 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:02.812305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:02.812625 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:02.813328 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:00:02.813349 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:02.815548 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:02.819414 (+ 3866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:02.819421 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:02.819431 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:02.819826 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:02.820233 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:02.820236 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:02.820238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:02.820406 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:02.820995 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:02.821000 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:02.821338 (+ 338us) client_negotiation.cc:769] Sending connection context
0807 07:00:02.821548 (+ 210us) client_negotiation.cc:240] Negotiation successful
0807 07:00:02.821883 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":258,"threads_started":1}
I20260807 07:00:02.824388 3544 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42115
I20260807 07:00:02.824680 3544 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:02.825428 3544 heartbeater.cc:511] Master 127.10.191.190:42115 requested a full tablet report, sending...
I20260807 07:00:02.827669 3239 ts_manager.cc:194] Registered new tserver with Master: 566b14ff7ce04adcb83103d8742068b5 (127.10.191.129:35103)
I20260807 07:00:02.829213 3239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:38073
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 07:00:02.875895 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42115
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:03.204715 3553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:03.204957 3553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:03.205040 3553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:03.211861 3553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:03.211948 3553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:03.212078 3553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 07:00:03.221315 3553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:03.222410 3553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:03.223608 3553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:03.236583 3561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:03.236543 3563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:03.236496 3567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:03.237485 3553 server_base.cc:1034] running on GCE node
I20260807 07:00:03.238080 3553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:03.239100 3553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:03.240326 3553 hybrid_clock.cc:648] HybridClock initialized: now 1786086003240283 us; error 56 us; skew 500 ppm
I20260807 07:00:03.240630 3553 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:03 dist-test-slave-tfpf krb5kdc[3179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086003, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:03.247496 3553 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 07:00:03.248811 3553 webserver.cc:460] Webserver started at http://127.10.191.130:33445/ using document root <none> and password file <none>
I20260807 07:00:03.249619 3553 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:03.249763 3553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:03.250072 3553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:03.252846 3553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "35d6fbe5ed41467e89147f3176351b7c"
format_stamp: "Formatted at 2026-08-07 07:00:03 on dist-test-slave-tfpf"
server_key: "4540b3bc6178ffca4cb15c6952f9a573"
server_key_iv: "9806faeba931a9e8a36c618f1d2db826"
server_key_version: "encryptionkey@0"
I20260807 07:00:03.253681 3553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "35d6fbe5ed41467e89147f3176351b7c"
format_stamp: "Formatted at 2026-08-07 07:00:03 on dist-test-slave-tfpf"
server_key: "4540b3bc6178ffca4cb15c6952f9a573"
server_key_iv: "9806faeba931a9e8a36c618f1d2db826"
server_key_version: "encryptionkey@0"
I20260807 07:00:03.258586 3553 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 07:00:03.261837 3577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:03.263051 3553 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 07:00:03.263221 3553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "35d6fbe5ed41467e89147f3176351b7c"
format_stamp: "Formatted at 2026-08-07 07:00:03 on dist-test-slave-tfpf"
server_key: "4540b3bc6178ffca4cb15c6952f9a573"
server_key_iv: "9806faeba931a9e8a36c618f1d2db826"
server_key_version: "encryptionkey@0"
I20260807 07:00:03.263396 3553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:03.276196 3553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:03.279906 3553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:03.280198 3553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:03.281142 3553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:03.282402 3553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:03.282476 3553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:03.282651 3553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:03.282714 3553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:03.315747 3553 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:42259
I20260807 07:00:03.315834 3753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:42259 every 8 connection(s)
I20260807 07:00:03.317145 3553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 07:00:03.320755 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 3553
I20260807 07:00:03.320950 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 07:00:03.321580 11006 external_mini_cluster.cc:1428] Setting key 6f6a99964b52d5e0669b764378d38f59
Aug 07 07:00:03 dist-test-slave-tfpf krb5kdc[3179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086003, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:03.337564 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.319703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:57433 (local address 127.10.191.190:42115)
0807 07:00:03.319888 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:03.319892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:03.321293 (+ 1401us) server_negotiation.cc:407] Connection header received
0807 07:00:03.323690 (+ 2397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:03.323694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:03.323819 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:03.323930 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:03.325503 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.326220 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.327885 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.328269 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.328435 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.331898 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:03.331903 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:03.331906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:03.331936 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:03.334485 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:03.335188 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:03.335200 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:03.335202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:03.335329 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:03.335784 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:03.335788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:03.335789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:03.336060 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:03.336226 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:03.336968 (+ 742us) server_negotiation.cc:299] Negotiation successful
0807 07:00:03.337232 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 07:00:03.338569 3757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.320186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42115 (local address 127.10.191.130:57433)
0807 07:00:03.321091 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:03.321151 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:03.323316 (+ 2165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:03.324182 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:03.324190 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:03.324678 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:03.325308 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.325362 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.326383 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.326393 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.327726 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.327769 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.328517 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.328524 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.328801 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.329550 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:00:03.329570 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:03.331667 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:03.334627 (+ 2960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:03.334635 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:03.334648 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:03.335055 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:03.335444 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:03.335449 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:03.335453 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:03.335639 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:03.336204 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:03.336211 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:03.336520 (+ 309us) client_negotiation.cc:769] Sending connection context
0807 07:00:03.336853 (+ 333us) client_negotiation.cc:240] Negotiation successful
0807 07:00:03.337382 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":313,"threads_started":1}
I20260807 07:00:03.339957 3754 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42115
I20260807 07:00:03.340255 3754 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:03.340921 3754 heartbeater.cc:511] Master 127.10.191.190:42115 requested a full tablet report, sending...
I20260807 07:00:03.342324 3239 ts_manager.cc:194] Registered new tserver with Master: 35d6fbe5ed41467e89147f3176351b7c (127.10.191.130:42259)
I20260807 07:00:03.343156 3239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:57433
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 07:00:03.388509 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42115
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:44733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:03.714794 3760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:03.715184 3760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:03.715374 3760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:03.722671 3760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:03.722810 3760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:03.723016 3760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 07:00:03.732633 3760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:03.733855 3760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:03.735133 3760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:03.747943 3767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:03.748047 3771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:03.748080 3768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:03.749243 3760 server_base.cc:1034] running on GCE node
I20260807 07:00:03.749881 3760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:03.750790 3760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:03.752014 3760 hybrid_clock.cc:648] HybridClock initialized: now 1786086003751973 us; error 53 us; skew 500 ppm
I20260807 07:00:03.752300 3760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:03 dist-test-slave-tfpf krb5kdc[3179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086003, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:03.755445 3760 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 07:00:03.756793 3760 webserver.cc:460] Webserver started at http://127.10.191.131:34159/ using document root <none> and password file <none>
I20260807 07:00:03.757500 3760 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:03.757637 3760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:03.757965 3760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:03.760722 3760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "2bc74c357a1a498abffb3dfbd61feea2"
format_stamp: "Formatted at 2026-08-07 07:00:03 on dist-test-slave-tfpf"
server_key: "239e66f331b49c5e49168782609fd31c"
server_key_iv: "1254b5fe61ccb6fdcfc857d8be81be82"
server_key_version: "encryptionkey@0"
I20260807 07:00:03.761518 3760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "2bc74c357a1a498abffb3dfbd61feea2"
format_stamp: "Formatted at 2026-08-07 07:00:03 on dist-test-slave-tfpf"
server_key: "239e66f331b49c5e49168782609fd31c"
server_key_iv: "1254b5fe61ccb6fdcfc857d8be81be82"
server_key_version: "encryptionkey@0"
I20260807 07:00:03.766543 3760 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 07:00:03.769939 3778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:03.771169 3760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 07:00:03.771332 3760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "2bc74c357a1a498abffb3dfbd61feea2"
format_stamp: "Formatted at 2026-08-07 07:00:03 on dist-test-slave-tfpf"
server_key: "239e66f331b49c5e49168782609fd31c"
server_key_iv: "1254b5fe61ccb6fdcfc857d8be81be82"
server_key_version: "encryptionkey@0"
I20260807 07:00:03.771519 3760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:03.790345 3760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:03.794399 3760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:03.794684 3760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:03.795644 3760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:03.796991 3760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:03.797115 3760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:03.797276 3760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:03.797328 3760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:03.831743 3760 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:39153
I20260807 07:00:03.831794 3945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:39153 every 8 connection(s)
I20260807 07:00:03.832723 3544 heartbeater.cc:503] Master 127.10.191.190:42115 was elected leader, sending a full tablet report...
I20260807 07:00:03.833042 3760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 07:00:03.834813 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 3760
I20260807 07:00:03.835054 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 07:00:03.835594 11006 external_mini_cluster.cc:1428] Setting key 09b44cd91b9eb674633cada84ab5f936
Aug 07 07:00:03 dist-test-slave-tfpf krb5kdc[3179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086003, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:03.854303 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.837632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:41867 (local address 127.10.191.190:42115)
0807 07:00:03.837866 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:03.837872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:03.839378 (+ 1506us) server_negotiation.cc:407] Connection header received
0807 07:00:03.841180 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:03.841184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:03.841247 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:03.841329 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:03.842795 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.843599 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.845056 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.845482 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.845583 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.848684 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:03.848688 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:03.848691 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:03.848720 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:03.851738 (+ 3018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:03.852339 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:03.852343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:03.852345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:03.852453 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:03.852817 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:03.852820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:03.852821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:03.853053 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:03.853215 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:03.853895 (+ 680us) server_negotiation.cc:299] Negotiation successful
0807 07:00:03.854051 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 07:00:03.855191 3948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.838278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42115 (local address 127.10.191.131:41867)
0807 07:00:03.839205 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:03.839248 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:03.840882 (+ 1634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:03.841575 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:03.841582 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:03.842073 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:03.842646 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.842670 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.843734 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.843738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.844937 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.844949 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.845679 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.845684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.845864 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.846480 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:00:03.846506 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:03.848508 (+ 2002us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:03.851852 (+ 3344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:03.851858 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:03.851867 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:03.852248 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:03.852561 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:03.852564 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:03.852566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:03.852730 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:03.853222 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:03.853227 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:03.853513 (+ 286us) client_negotiation.cc:769] Sending connection context
0807 07:00:03.853809 (+ 296us) client_negotiation.cc:240] Negotiation successful
0807 07:00:03.854159 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":420,"threads_started":1}
I20260807 07:00:03.856401 3946 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42115
I20260807 07:00:03.856725 3946 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:03.857488 3946 heartbeater.cc:511] Master 127.10.191.190:42115 requested a full tablet report, sending...
I20260807 07:00:03.858816 3239 ts_manager.cc:194] Registered new tserver with Master: 2bc74c357a1a498abffb3dfbd61feea2 (127.10.191.131:39153)
I20260807 07:00:03.859584 3239 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:41867
I20260807 07:00:03.862879 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 07:00:03.879581 3548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.867481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40836 (local address 127.10.191.190:42115)
0807 07:00:03.867711 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:03.867714 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:03.868171 (+ 457us) server_negotiation.cc:407] Connection header received
0807 07:00:03.868362 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:03.868368 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:03.868440 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:03.868544 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:03.870046 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.870681 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.871937 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.872342 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.872474 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.874899 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:03.874911 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:03.874914 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:03.874942 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:03.877374 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:03.878012 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:03.878016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:03.878018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:03.878142 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:03.878461 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:03.878464 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:03.878466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:03.878749 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:03.878932 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:03.879200 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 07:00:03.879351 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260807 07:00:03.884310 3239 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40836:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:00:03.891182 3239 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:00:03.913082 3964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.902500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39153 (local address 127.0.0.1:43294)
0807 07:00:03.903278 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:03.903329 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:03.903536 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:03.904931 (+ 1395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:03.904938 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:03.904976 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:03.905449 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.905463 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.907827 (+ 2364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.907834 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.910051 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.910074 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.911871 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.911879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.912061 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.912111 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 07:00:03.912237 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 07:00:03.912719 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":543,"threads_started":1}
I20260807 07:00:03.913259 3965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.902693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43294 (local address 127.10.191.131:39153)
0807 07:00:03.904261 (+ 1568us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:03.904271 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:03.904308 (+ 37us) server_negotiation.cc:407] Connection header received
0807 07:00:03.904417 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:03.904424 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:03.904686 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:03.905524 (+ 838us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:03.905801 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.907688 (+ 1887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.910228 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.911653 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.912516 (+ 863us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.912692 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:03.912762 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 07:00:03.912917 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1391,"thread_start_us":1229,"threads_started":1}
I20260807 07:00:03.914027 3967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.902872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:35103 (local address 127.0.0.1:41644)
0807 07:00:03.904530 (+ 1658us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:03.904547 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:03.905260 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:03.907166 (+ 1906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:03.907170 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:03.907207 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:03.907589 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.907602 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.909630 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.909635 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.911255 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.911271 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.913208 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.913214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.913379 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.913411 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 07:00:03.913563 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 07:00:03.913707 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1539,"mutex_wait_us":45,"thread_start_us":1382,"threads_started":1}
I20260807 07:00:03.914803 3969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.904181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41644 (local address 127.10.191.129:35103)
0807 07:00:03.906477 (+ 2296us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:03.906485 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:03.906511 (+ 26us) server_negotiation.cc:407] Connection header received
0807 07:00:03.906620 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:03.906627 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:03.906832 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:03.907038 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:03.907793 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.909478 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.911414 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.912795 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.912965 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.914344 (+ 1379us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:03.914422 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 07:00:03.914595 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2128,"thread_start_us":1969,"threads_started":1}
I20260807 07:00:03.915041 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.903339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:42259 (local address 127.0.0.1:58896)
0807 07:00:03.906830 (+ 3491us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:03.906845 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:03.906995 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:03.907835 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:03.907840 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:03.907872 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:03.908381 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.908394 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.910088 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.910094 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.912242 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:03.912256 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.914214 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.914237 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:03.914400 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.914435 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 07:00:03.914577 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 07:00:03.914699 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3354,"mutex_wait_us":22,"thread_start_us":3212,"threads_started":1}
I20260807 07:00:03.915784 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:03.904554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58896 (local address 127.10.191.130:42259)
0807 07:00:03.905940 (+ 1386us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:03.905948 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:03.906950 (+ 1002us) server_negotiation.cc:407] Connection header received
0807 07:00:03.907179 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:03.907198 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:03.907417 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:03.907609 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:03.908576 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.909951 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.912399 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:03.913810 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:03.913986 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:03.914149 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:03.915350 (+ 1201us) server_negotiation.cc:299] Negotiation successful
0807 07:00:03.915499 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1234,"thread_start_us":1122,"threads_started":1}
I20260807 07:00:03.917388 3851 tablet_service.cc:1467] Processing CreateTablet for tablet 364a0eb81fc34540b0fd32c77c4ad723 (DEFAULT_TABLE table=test-table [id=9267fc730d424cf6ba00271e2dc0ed60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:03.918299 3427 tablet_service.cc:1467] Processing CreateTablet for tablet 364a0eb81fc34540b0fd32c77c4ad723 (DEFAULT_TABLE table=test-table [id=9267fc730d424cf6ba00271e2dc0ed60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:03.918995 3851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 364a0eb81fc34540b0fd32c77c4ad723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:03.919386 3427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 364a0eb81fc34540b0fd32c77c4ad723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:03.919767 3654 tablet_service.cc:1467] Processing CreateTablet for tablet 364a0eb81fc34540b0fd32c77c4ad723 (DEFAULT_TABLE table=test-table [id=9267fc730d424cf6ba00271e2dc0ed60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:03.921295 3654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 364a0eb81fc34540b0fd32c77c4ad723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:03.930640 3972 tablet_bootstrap.cc:492] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: Bootstrap starting.
I20260807 07:00:03.934302 3972 tablet_bootstrap.cc:654] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:03.933658 3973 tablet_bootstrap.cc:492] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: Bootstrap starting.
I20260807 07:00:03.935345 3974 tablet_bootstrap.cc:492] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: Bootstrap starting.
I20260807 07:00:03.935663 3972 log.cc:824] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:03.937923 3973 tablet_bootstrap.cc:654] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:03.938799 3974 tablet_bootstrap.cc:654] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:03.938994 3972 tablet_bootstrap.cc:492] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: No bootstrap required, opened a new log
I20260807 07:00:03.939064 3973 log.cc:824] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:03.939301 3972 ts_tablet_manager.cc:1397] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260807 07:00:03.940050 3974 log.cc:824] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:03.942775 3974 tablet_bootstrap.cc:492] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: No bootstrap required, opened a new log
I20260807 07:00:03.942893 3973 tablet_bootstrap.cc:492] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: No bootstrap required, opened a new log
I20260807 07:00:03.943107 3974 ts_tablet_manager.cc:1397] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20260807 07:00:03.943173 3973 ts_tablet_manager.cc:1397] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260807 07:00:03.949177 3972 raft_consensus.cc:348] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } }
I20260807 07:00:03.949558 3972 raft_consensus.cc:374] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:03.949651 3972 raft_consensus.cc:729] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566b14ff7ce04adcb83103d8742068b5, State: Initialized, Role: FOLLOWER
I20260807 07:00:03.950145 3974 raft_consensus.cc:348] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } }
I20260807 07:00:03.950222 3972 consensus_queue.cc:260] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } }
I20260807 07:00:03.950454 3974 raft_consensus.cc:374] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:03.950574 3974 raft_consensus.cc:729] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35d6fbe5ed41467e89147f3176351b7c, State: Initialized, Role: FOLLOWER
I20260807 07:00:03.951150 3974 consensus_queue.cc:260] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } }
I20260807 07:00:03.952219 3754 heartbeater.cc:503] Master 127.10.191.190:42115 was elected leader, sending a full tablet report...
I20260807 07:00:03.953843 3973 raft_consensus.cc:348] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } }
I20260807 07:00:03.954408 3973 raft_consensus.cc:374] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:03.954530 3974 ts_tablet_manager.cc:1428] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: Time spent starting tablet: real 0.011s user 0.005s sys 0.004s
I20260807 07:00:03.954577 3973 raft_consensus.cc:729] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bc74c357a1a498abffb3dfbd61feea2, State: Initialized, Role: FOLLOWER
I20260807 07:00:03.955291 3973 consensus_queue.cc:260] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } }
I20260807 07:00:03.956959 3946 heartbeater.cc:503] Master 127.10.191.190:42115 was elected leader, sending a full tablet report...
I20260807 07:00:03.957302 3973 ts_tablet_manager.cc:1428] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260807 07:00:03.958863 3972 ts_tablet_manager.cc:1428] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: Time spent starting tablet: real 0.019s user 0.009s sys 0.011s
I20260807 07:00:04.022873 3987 raft_consensus.cc:482] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:00:04.023231 3987 raft_consensus.cc:504] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } }
I20260807 07:00:04.025141 3987 leader_election.cc:288] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 566b14ff7ce04adcb83103d8742068b5 (127.10.191.129:35103), 35d6fbe5ed41467e89147f3176351b7c (127.10.191.130:42259)
I20260807 07:00:04.031069 3948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:04.025344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:35103 (local address 127.10.191.131:33957)
0807 07:00:04.025545 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:04.025566 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:04.025695 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:04.026395 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:04.026400 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:04.026447 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:04.026641 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:04.026649 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.027782 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.027789 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:04.029182 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:04.029194 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.030337 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.030343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:04.030518 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:04.030542 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 07:00:04.030653 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 07:00:04.030789 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"spinlock_wait_cycles":33024}
I20260807 07:00:04.031051 3969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:04.025811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:33957 (local address 127.10.191.129:35103)
0807 07:00:04.026024 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:04.026030 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:04.026051 (+ 21us) server_negotiation.cc:407] Connection header received
0807 07:00:04.026154 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:04.026162 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:04.026244 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:04.026351 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:04.026791 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.027657 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.029350 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.030191 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.030350 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:04.030422 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:04.030680 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 07:00:04.030799 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 07:00:04.031419 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:04.026091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:53917 (local address 127.10.191.130:42259)
0807 07:00:04.026300 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:04.026307 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:04.026414 (+ 107us) server_negotiation.cc:407] Connection header received
0807 07:00:04.026606 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:04.026609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:04.026667 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:04.026768 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:04.027288 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.027999 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.029705 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.030546 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.030724 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:04.030797 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:04.031069 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 07:00:04.031189 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 07:00:04.031487 3988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:04.025536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:42259 (local address 127.10.191.131:53917)
0807 07:00:04.026280 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:04.026294 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:04.026435 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:04.026810 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:04.026813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:04.026833 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:04.027099 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:04.027106 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.028151 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.028155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:04.029526 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:04.029539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.030756 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.030762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:04.030905 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:04.030928 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 07:00:04.031043 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 07:00:04.031155 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":410,"threads_started":1}
I20260807 07:00:04.032110 3463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "364a0eb81fc34540b0fd32c77c4ad723" candidate_uuid: "2bc74c357a1a498abffb3dfbd61feea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566b14ff7ce04adcb83103d8742068b5" is_pre_election: true
I20260807 07:00:04.032681 3463 raft_consensus.cc:2454] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bc74c357a1a498abffb3dfbd61feea2 in term 0.
I20260807 07:00:04.032766 3687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "364a0eb81fc34540b0fd32c77c4ad723" candidate_uuid: "2bc74c357a1a498abffb3dfbd61feea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d6fbe5ed41467e89147f3176351b7c" is_pre_election: true
I20260807 07:00:04.033301 3687 raft_consensus.cc:2454] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bc74c357a1a498abffb3dfbd61feea2 in term 0.
I20260807 07:00:04.033329 3782 leader_election.cc:302] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bc74c357a1a498abffb3dfbd61feea2, 566b14ff7ce04adcb83103d8742068b5; no voters:
I20260807 07:00:04.033699 3987 raft_consensus.cc:2781] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:00:04.033874 3987 raft_consensus.cc:482] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:00:04.033984 3987 raft_consensus.cc:3037] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:04.036079 3987 raft_consensus.cc:504] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } }
I20260807 07:00:04.036697 3987 leader_election.cc:288] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [CANDIDATE]: Term 1 election: Requested vote from peers 566b14ff7ce04adcb83103d8742068b5 (127.10.191.129:35103), 35d6fbe5ed41467e89147f3176351b7c (127.10.191.130:42259)
I20260807 07:00:04.037045 3463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "364a0eb81fc34540b0fd32c77c4ad723" candidate_uuid: "2bc74c357a1a498abffb3dfbd61feea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "566b14ff7ce04adcb83103d8742068b5"
I20260807 07:00:04.037209 3687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "364a0eb81fc34540b0fd32c77c4ad723" candidate_uuid: "2bc74c357a1a498abffb3dfbd61feea2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35d6fbe5ed41467e89147f3176351b7c"
I20260807 07:00:04.037293 3463 raft_consensus.cc:3037] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:04.037447 3687 raft_consensus.cc:3037] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:04.039665 3463 raft_consensus.cc:2454] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bc74c357a1a498abffb3dfbd61feea2 in term 1.
I20260807 07:00:04.039783 3687 raft_consensus.cc:2454] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bc74c357a1a498abffb3dfbd61feea2 in term 1.
I20260807 07:00:04.040096 3782 leader_election.cc:302] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bc74c357a1a498abffb3dfbd61feea2, 566b14ff7ce04adcb83103d8742068b5; no voters:
I20260807 07:00:04.040374 3987 raft_consensus.cc:2781] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:04.040786 3987 raft_consensus.cc:686] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 1 LEADER]: Becoming Leader. State: Replica: 2bc74c357a1a498abffb3dfbd61feea2, State: Running, Role: LEADER
I20260807 07:00:04.041273 3987 consensus_queue.cc:237] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } }
I20260807 07:00:04.045790 3238 catalog_manager.cc:5495] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bc74c357a1a498abffb3dfbd61feea2 (127.10.191.131). New cstate: current_term: 1 leader_uuid: "2bc74c357a1a498abffb3dfbd61feea2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bc74c357a1a498abffb3dfbd61feea2" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 } health_report { overall_health: UNKNOWN } } }
W20260807 07:00:04.053452 3545 tablet.cc:2369] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:00:04.066464 3965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:04.061209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43296 (local address 127.10.191.131:39153)
0807 07:00:04.061393 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:04.061398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:04.061537 (+ 139us) server_negotiation.cc:407] Connection header received
0807 07:00:04.061757 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:04.061761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:04.061823 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:04.061957 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:00:04.062312 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.062941 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.064215 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.064634 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.064759 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:04.065278 (+ 519us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:00:04.065830 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:00:04.065990 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:04.066118 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 07:00:04.066219 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260807 07:00:04.069058 3756 tablet.cc:2369] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:00:04.073647 3463 raft_consensus.cc:1261] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [term 1 FOLLOWER]: Refusing update from remote peer 2bc74c357a1a498abffb3dfbd61feea2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:04.073653 3687 raft_consensus.cc:1261] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [term 1 FOLLOWER]: Refusing update from remote peer 2bc74c357a1a498abffb3dfbd61feea2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:04.074672 3989 consensus_queue.cc:1035] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35d6fbe5ed41467e89147f3176351b7c" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 42259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:04.075014 3987 consensus_queue.cc:1035] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "566b14ff7ce04adcb83103d8742068b5" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 35103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 07:00:04.085038 3947 tablet.cc:2369] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:00:04.089288 3994 mvcc.cc:205] Tried to move back new op lower bound from 7315808272676651008 to 7315808272556847104. Current Snapshot: MvccSnapshot[applied={T|T < 7315808272676651008}]
I20260807 07:00:04.104012 3239 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:04.104278 3239 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:04.107956 3239 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 044482062aae43c4abd6d64a7ad3591a: Sending DeleteTablet for 3 replicas of tablet 364a0eb81fc34540b0fd32c77c4ad723
I20260807 07:00:04.108940 3851 tablet_service.cc:1514] Processing DeleteTablet for tablet 364a0eb81fc34540b0fd32c77c4ad723 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:04 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:43294
I20260807 07:00:04.109097 3427 tablet_service.cc:1514] Processing DeleteTablet for tablet 364a0eb81fc34540b0fd32c77c4ad723 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:04 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:41644
I20260807 07:00:04.109105 3654 tablet_service.cc:1514] Processing DeleteTablet for tablet 364a0eb81fc34540b0fd32c77c4ad723 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:04 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:58896
I20260807 07:00:04.110908 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 3324
I20260807 07:00:04.115001 4006 tablet_replica.cc:330] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: stopping tablet replica
I20260807 07:00:04.117533 4006 raft_consensus.cc:2229] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:00:04.118311 4006 raft_consensus.cc:2258] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:04.121688 4006 ts_tablet_manager.cc:1905] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:04.137778 4009 tablet_replica.cc:330] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: stopping tablet replica
I20260807 07:00:04.138273 4009 raft_consensus.cc:2229] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:04.138895 4009 raft_consensus.cc:2258] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:04.139739 4006 ts_tablet_manager.cc:1918] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:04.139907 4006 log.cc:1196] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/364a0eb81fc34540b0fd32c77c4ad723
I20260807 07:00:04.140251 4008 tablet_replica.cc:330] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: stopping tablet replica
I20260807 07:00:04.140482 4006 ts_tablet_manager.cc:1939] T 364a0eb81fc34540b0fd32c77c4ad723 P 2bc74c357a1a498abffb3dfbd61feea2: Deleting consensus metadata
I20260807 07:00:04.140654 4008 raft_consensus.cc:2229] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:04.141130 4008 raft_consensus.cc:2258] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:04.143329 4009 ts_tablet_manager.cc:1905] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 07:00:04 dist-test-slave-tfpf krb5kdc[3179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 07:00:04.145530 4008 ts_tablet_manager.cc:1905] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:04.145787 3218 catalog_manager.cc:4841] TS 2bc74c357a1a498abffb3dfbd61feea2 (127.10.191.131:39153): tablet 364a0eb81fc34540b0fd32c77c4ad723 (table test-table [id=9267fc730d424cf6ba00271e2dc0ed60]) successfully deleted
I20260807 07:00:04.151825 4009 ts_tablet_manager.cc:1918] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:04.151989 4009 log.cc:1196] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/364a0eb81fc34540b0fd32c77c4ad723
I20260807 07:00:04.152558 4009 ts_tablet_manager.cc:1939] T 364a0eb81fc34540b0fd32c77c4ad723 P 566b14ff7ce04adcb83103d8742068b5: Deleting consensus metadata
I20260807 07:00:04.152535 4008 ts_tablet_manager.cc:1918] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:04.152701 4008 log.cc:1196] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/364a0eb81fc34540b0fd32c77c4ad723
I20260807 07:00:04.153261 4008 ts_tablet_manager.cc:1939] T 364a0eb81fc34540b0fd32c77c4ad723 P 35d6fbe5ed41467e89147f3176351b7c: Deleting consensus metadata
I20260807 07:00:04.153978 3969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:04.113129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41658 (local address 127.10.191.129:35103)
0807 07:00:04.113288 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:04.113294 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:04.127995 (+ 14701us) server_negotiation.cc:407] Connection header received
0807 07:00:04.128479 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:04.128485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:04.128583 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:04.128675 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:04.130505 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.131735 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.137672 (+ 5937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.138630 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.138754 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:04.145860 (+ 7106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:04.145874 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:04.145890 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:04.145929 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:04.149978 (+ 4049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:04.150948 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:04.150956 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:04.150960 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:04.151137 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:04.151638 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:04.151644 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:04.151647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:04.152251 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:04.152552 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:04.153309 (+ 757us) server_negotiation.cc:299] Negotiation successful
0807 07:00:04.153606 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 07:00:04.154268 3215 catalog_manager.cc:4841] TS 566b14ff7ce04adcb83103d8742068b5 (127.10.191.129:35103): tablet 364a0eb81fc34540b0fd32c77c4ad723 (table test-table [id=9267fc730d424cf6ba00271e2dc0ed60]) successfully deleted
I20260807 07:00:04.154764 3217 catalog_manager.cc:4841] TS 35d6fbe5ed41467e89147f3176351b7c (127.10.191.130:42259): tablet 364a0eb81fc34540b0fd32c77c4ad723 (table test-table [id=9267fc730d424cf6ba00271e2dc0ed60]) successfully deleted
I20260807 07:00:04.155606 3537 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:04.261673 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 3324
I20260807 07:00:04.288419 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 3553
Aug 07 07:00:04 dist-test-slave-tfpf krb5kdc[3179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 07:00:04.305313 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:04.289429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58902 (local address 127.10.191.130:42259)
0807 07:00:04.289668 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:04.289674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:04.289697 (+ 23us) server_negotiation.cc:407] Connection header received
0807 07:00:04.289768 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:04.289773 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:04.289865 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:04.290001 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:04.291318 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.292482 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.293821 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.294423 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.294555 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:04.298949 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:04.298966 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:04.298985 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:04.299028 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:04.302489 (+ 3461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:04.303143 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:04.303152 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:04.303155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:04.303303 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:04.303656 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:04.303661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:04.303664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:04.304201 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:04.304510 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:04.304695 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 07:00:04.304919 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 07:00:04.306095 3747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:04.394591 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 3553
I20260807 07:00:04.421672 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 3760
Aug 07 07:00:04 dist-test-slave-tfpf krb5kdc[3179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 07:00:04.440281 3965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:04.422564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43308 (local address 127.10.191.131:39153)
0807 07:00:04.422769 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:04.422774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:04.422851 (+ 77us) server_negotiation.cc:407] Connection header received
0807 07:00:04.423083 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:04.423087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:04.423150 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:04.423243 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:04.425190 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.426023 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.427942 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:04.428404 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:04.428493 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:04.434175 (+ 5682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:04.434187 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:04.434202 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:04.434241 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:04.437390 (+ 3149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:04.438094 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:04.438101 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:04.438103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:04.438273 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:04.438653 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:04.438658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:04.438666 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:04.439008 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:04.439361 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:04.439628 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 07:00:04.439869 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 07:00:04.441159 3940 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:04.565255 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 3760
I20260807 07:00:04.592979 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 3195
I20260807 07:00:04.594300 3282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:04.707197 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 3195
2026-08-07T07:00:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4517 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T07:00:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:04Z Disabled control of system clock
I20260807 07:00:04.810523 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:44093
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:35523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:44093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 07:00:05.156705 4024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:05.156970 4024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:05.157051 4024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:05.163496 4024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:05.163578 4024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:05.163618 4024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:05.163697 4024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:05.163755 4024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:05.172084 4024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:44093
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:44093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:05.173189 4024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:05.174845 4024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:05.186213 4035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:05.186252 4033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:05.186163 4032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:05.187104 4024 server_base.cc:1034] running on GCE node
I20260807 07:00:05.187763 4024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:05.189044 4024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:05.190346 4024 hybrid_clock.cc:648] HybridClock initialized: now 1786086005190298 us; error 40 us; skew 500 ppm
I20260807 07:00:05.190702 4024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:05.192862 4024 webserver.cc:460] Webserver started at http://127.10.191.190:36869/ using document root <none> and password file <none>
I20260807 07:00:05.193600 4024 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:05.193732 4024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:05.194054 4024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:05.196871 4024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "b256f08d28274a12b789dd89e97438c7"
format_stamp: "Formatted at 2026-08-07 07:00:05 on dist-test-slave-tfpf"
server_key: "bc46f10525bdfee62e1cde107bb9e126"
server_key_iv: "47fa5cece80848760499c11ffcacbb8c"
server_key_version: "encryptionkey@0"
I20260807 07:00:05.197772 4024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "b256f08d28274a12b789dd89e97438c7"
format_stamp: "Formatted at 2026-08-07 07:00:05 on dist-test-slave-tfpf"
server_key: "bc46f10525bdfee62e1cde107bb9e126"
server_key_iv: "47fa5cece80848760499c11ffcacbb8c"
server_key_version: "encryptionkey@0"
I20260807 07:00:05.202641 4024 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 07:00:05.205902 4042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:05.207181 4024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 07:00:05.207382 4024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "b256f08d28274a12b789dd89e97438c7"
format_stamp: "Formatted at 2026-08-07 07:00:05 on dist-test-slave-tfpf"
server_key: "bc46f10525bdfee62e1cde107bb9e126"
server_key_iv: "47fa5cece80848760499c11ffcacbb8c"
server_key_version: "encryptionkey@0"
I20260807 07:00:05.207602 4024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:05.220758 4024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:05.221521 4024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:05.221802 4024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:05.240067 4024 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:44093
I20260807 07:00:05.240099 4127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:44093 every 8 connection(s)
I20260807 07:00:05.241402 4024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:05.244956 4128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:05.247607 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 4024
I20260807 07:00:05.247814 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:05.248386 11006 external_mini_cluster.cc:1428] Setting key 966cdb2f0f97d4cc0436f43a5193cb0c
I20260807 07:00:05.256852 4128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7: Bootstrap starting.
I20260807 07:00:05.260443 4128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:05.261404 4133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:05.250292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47946 (local address 127.10.191.190:44093)
0807 07:00:05.251242 (+ 950us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:05.251252 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:05.251288 (+ 36us) server_negotiation.cc:407] Connection header received
0807 07:00:05.252776 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:05.252796 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:05.253247 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:05.253539 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:05.254106 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:05.255329 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:05.257240 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:05.257923 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:05.258058 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:05.259296 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:05.259302 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:05.259313 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:05.259798 (+ 485us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:05.259878 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:05.259898 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:05.259983 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:05.260218 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 07:00:05.260477 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":396,"threads_started":1}
I20260807 07:00:05.261518 4128 log.cc:824] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:05.264348 4128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7: No bootstrap required, opened a new log
I20260807 07:00:05.271545 4128 raft_consensus.cc:348] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b256f08d28274a12b789dd89e97438c7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44093 } }
I20260807 07:00:05.271924 4128 raft_consensus.cc:374] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:05.272032 4128 raft_consensus.cc:729] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b256f08d28274a12b789dd89e97438c7, State: Initialized, Role: FOLLOWER
I20260807 07:00:05.272696 4128 consensus_queue.cc:260] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b256f08d28274a12b789dd89e97438c7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44093 } }
I20260807 07:00:05.272956 4128 raft_consensus.cc:388] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:05.273113 4128 raft_consensus.cc:482] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:05.273316 4128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:05.275650 4128 raft_consensus.cc:504] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b256f08d28274a12b789dd89e97438c7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44093 } }
I20260807 07:00:05.276196 4128 leader_election.cc:302] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b256f08d28274a12b789dd89e97438c7; no voters:
I20260807 07:00:05.276798 4128 leader_election.cc:288] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:05.276942 4135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:05.277738 4135 raft_consensus.cc:686] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [term 1 LEADER]: Becoming Leader. State: Replica: b256f08d28274a12b789dd89e97438c7, State: Running, Role: LEADER
I20260807 07:00:05.278275 4135 consensus_queue.cc:237] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b256f08d28274a12b789dd89e97438c7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44093 } }
I20260807 07:00:05.278892 4128 sys_catalog.cc:564] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:05.281193 4138 sys_catalog.cc:455] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b256f08d28274a12b789dd89e97438c7. Latest consensus state: current_term: 1 leader_uuid: "b256f08d28274a12b789dd89e97438c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b256f08d28274a12b789dd89e97438c7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44093 } } }
I20260807 07:00:05.281666 4138 sys_catalog.cc:458] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:05.283506 4136 sys_catalog.cc:455] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b256f08d28274a12b789dd89e97438c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b256f08d28274a12b789dd89e97438c7" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 44093 } } }
I20260807 07:00:05.283869 4136 sys_catalog.cc:458] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7 [sys.catalog]: This master's current role is: LEADER
W20260807 07:00:05.292021 4171 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 07:00:05.292155 4171 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 07:00:05.292294 4155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:05.293936 4155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:05.301545 4155 catalog_manager.cc:1347] Generated new cluster ID: 6758b39237dc4eb185d9bbbabb449398
I20260807 07:00:05.301648 4155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:05.353586 4155 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:05.354954 4155 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:05.365206 4155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7: Generated new TSK 0
I20260807 07:00:05.365927 4155 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:05.371841 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44093
--builtin_ntp_servers=127.10.191.148:35523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 07:00:05.714382 4176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:05.714655 4176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:05.714830 4176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:05.722141 4176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:05.722268 4176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:05.722474 4176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 07:00:05.730829 4176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:05.731982 4176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:05.733842 4176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:05.747381 4182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:05.747426 4181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:05.747467 4184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:05.748368 4176 server_base.cc:1034] running on GCE node
I20260807 07:00:05.748914 4176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:05.749900 4176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:05.751132 4176 hybrid_clock.cc:648] HybridClock initialized: now 1786086005751089 us; error 29 us; skew 500 ppm
I20260807 07:00:05.751406 4176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:05.753684 4176 webserver.cc:460] Webserver started at http://127.10.191.129:43535/ using document root <none> and password file <none>
I20260807 07:00:05.754336 4176 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:05.754431 4176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:05.754796 4176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:05.757746 4176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "85b02884dcd54a298870aff0f2f4962a"
format_stamp: "Formatted at 2026-08-07 07:00:05 on dist-test-slave-tfpf"
server_key: "3921f8100751c70ca77dcad65a026c66"
server_key_iv: "89f3f1dab1c0b40046ce7e3aebaffa4b"
server_key_version: "encryptionkey@0"
I20260807 07:00:05.758605 4176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "85b02884dcd54a298870aff0f2f4962a"
format_stamp: "Formatted at 2026-08-07 07:00:05 on dist-test-slave-tfpf"
server_key: "3921f8100751c70ca77dcad65a026c66"
server_key_iv: "89f3f1dab1c0b40046ce7e3aebaffa4b"
server_key_version: "encryptionkey@0"
I20260807 07:00:05.764168 4176 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 07:00:05.767612 4191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:05.768887 4176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 07:00:05.769119 4176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "85b02884dcd54a298870aff0f2f4962a"
format_stamp: "Formatted at 2026-08-07 07:00:05 on dist-test-slave-tfpf"
server_key: "3921f8100751c70ca77dcad65a026c66"
server_key_iv: "89f3f1dab1c0b40046ce7e3aebaffa4b"
server_key_version: "encryptionkey@0"
I20260807 07:00:05.769345 4176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:05.794426 4176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:05.795174 4176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:05.795477 4176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:05.796406 4176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:05.797873 4176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:05.797992 4176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:05.798130 4176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:05.798230 4176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:05.831408 4176 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:36763
I20260807 07:00:05.831498 4362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:36763 every 8 connection(s)
I20260807 07:00:05.832752 4176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 07:00:05.835985 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 4176
I20260807 07:00:05.836215 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 07:00:05.836719 11006 external_mini_cluster.cc:1428] Setting key 130bd23a2d7bed268d57e0fc7028464c
I20260807 07:00:05.839740 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44093
--builtin_ntp_servers=127.10.191.148:35523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 07:00:05.846529 4366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:05.835471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:47595 (local address 127.10.191.190:44093)
0807 07:00:05.836033 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:05.836039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:05.837408 (+ 1369us) server_negotiation.cc:407] Connection header received
0807 07:00:05.839197 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:05.839203 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:05.839282 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:05.839409 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:05.840567 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:05.841863 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:05.843368 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:05.844073 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:05.844228 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:05.845536 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:05.845545 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:05.845552 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:05.845577 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:05.845650 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:05.845668 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:05.845767 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:05.845969 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 07:00:05.846078 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":258,"threads_started":1}
I20260807 07:00:05.847190 4367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:05.836047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:44093 (local address 127.10.191.129:47595)
0807 07:00:05.837219 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:05.837275 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:05.838922 (+ 1647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:05.839595 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:05.839603 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:05.839688 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:05.840394 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:05.840413 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:05.842016 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:05.842019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:05.843211 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:05.843224 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:05.844289 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:05.844294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:05.844482 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:05.845238 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 07:00:05.845240 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:05.845276 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 07:00:05.845350 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:05.845773 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:05.845782 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:05.845787 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 07:00:05.845920 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 07:00:05.846194 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":382,"threads_started":1}
I20260807 07:00:05.848871 4363 heartbeater.cc:347] Connected to a master server at 127.10.191.190:44093
I20260807 07:00:05.849210 4363 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:05.849931 4363 heartbeater.cc:511] Master 127.10.191.190:44093 requested a full tablet report, sending...
I20260807 07:00:05.852120 4069 ts_manager.cc:194] Registered new tserver with Master: 85b02884dcd54a298870aff0f2f4962a (127.10.191.129:36763)
I20260807 07:00:05.854095 4069 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.129:47595
W20260807 07:00:06.177726 4368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:06.178053 4368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:06.178236 4368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:06.185299 4368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:06.185406 4368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:06.185549 4368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 07:00:06.193727 4368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:06.194808 4368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:06.196442 4368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:06.209041 4375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:06.209192 4374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:06.209198 4379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:06.210038 4368 server_base.cc:1034] running on GCE node
I20260807 07:00:06.210721 4368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:06.211750 4368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:06.212984 4368 hybrid_clock.cc:648] HybridClock initialized: now 1786086006212923 us; error 49 us; skew 500 ppm
I20260807 07:00:06.213318 4368 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:06.215559 4368 webserver.cc:460] Webserver started at http://127.10.191.130:46103/ using document root <none> and password file <none>
I20260807 07:00:06.216271 4368 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:06.216411 4368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:06.216758 4368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:06.219848 4368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "628a3327b5b04834a0b9e85ac1639d1a"
format_stamp: "Formatted at 2026-08-07 07:00:06 on dist-test-slave-tfpf"
server_key: "f504ca5007cbff936037dcfbfc072ac7"
server_key_iv: "3c0913487ee0c343b03d6fdf31faa44f"
server_key_version: "encryptionkey@0"
I20260807 07:00:06.220649 4368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "628a3327b5b04834a0b9e85ac1639d1a"
format_stamp: "Formatted at 2026-08-07 07:00:06 on dist-test-slave-tfpf"
server_key: "f504ca5007cbff936037dcfbfc072ac7"
server_key_iv: "3c0913487ee0c343b03d6fdf31faa44f"
server_key_version: "encryptionkey@0"
I20260807 07:00:06.225329 4368 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260807 07:00:06.228715 4388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:06.230027 4368 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 07:00:06.230217 4368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "628a3327b5b04834a0b9e85ac1639d1a"
format_stamp: "Formatted at 2026-08-07 07:00:06 on dist-test-slave-tfpf"
server_key: "f504ca5007cbff936037dcfbfc072ac7"
server_key_iv: "3c0913487ee0c343b03d6fdf31faa44f"
server_key_version: "encryptionkey@0"
I20260807 07:00:06.230430 4368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:06.245399 4368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:06.246114 4368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:06.246451 4368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:06.247393 4368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:06.248878 4368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:06.248999 4368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:06.249125 4368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:06.249251 4368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:06.282733 4368 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:36995
I20260807 07:00:06.282779 4553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:36995 every 8 connection(s)
I20260807 07:00:06.284042 4368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 07:00:06.294297 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 4368
I20260807 07:00:06.294498 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 07:00:06.294947 11006 external_mini_cluster.cc:1428] Setting key df2ee07a2de1d5b94a1df6d1d62d00ed
I20260807 07:00:06.296365 4366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.286590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:49009 (local address 127.10.191.190:44093)
0807 07:00:06.286784 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.286788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.288019 (+ 1231us) server_negotiation.cc:407] Connection header received
0807 07:00:06.289798 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.289803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.289886 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.289987 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:06.290937 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.291601 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.293448 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.293856 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.293997 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.295385 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:06.295389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:06.295392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:06.295427 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:06.295468 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:06.295485 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:06.295584 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.295850 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.295956 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 07:00:06.297497 4556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.286992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:44093 (local address 127.10.191.130:49009)
0807 07:00:06.287865 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:06.287905 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:06.289536 (+ 1631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:06.290207 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:06.290214 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:06.290288 (+ 74us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:06.290784 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.290799 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.291765 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.291769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.293288 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.293300 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.294117 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.294126 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.294319 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.295086 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 07:00:06.295090 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:06.295142 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 07:00:06.295215 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:06.295600 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:06.295609 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:06.295615 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 07:00:06.295822 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 07:00:06.296172 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":290,"threads_started":1}
I20260807 07:00:06.298251 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44093
--builtin_ntp_servers=127.10.191.148:35523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 07:00:06.299115 4554 heartbeater.cc:347] Connected to a master server at 127.10.191.190:44093
I20260807 07:00:06.299405 4554 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:06.300127 4554 heartbeater.cc:511] Master 127.10.191.190:44093 requested a full tablet report, sending...
I20260807 07:00:06.301582 4069 ts_manager.cc:194] Registered new tserver with Master: 628a3327b5b04834a0b9e85ac1639d1a (127.10.191.130:36995)
I20260807 07:00:06.302726 4069 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.130:49009
W20260807 07:00:06.629614 4557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:06.629910 4557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:06.630080 4557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:06.636866 4557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:06.636989 4557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:06.637181 4557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 07:00:06.645454 4557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:44093
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:06.646646 4557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:06.648411 4557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:06.661021 4565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:06.661084 4569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:06.661144 4566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:06.662323 4557 server_base.cc:1034] running on GCE node
I20260807 07:00:06.662995 4557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:06.663975 4557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:06.665215 4557 hybrid_clock.cc:648] HybridClock initialized: now 1786086006665169 us; error 44 us; skew 500 ppm
I20260807 07:00:06.665552 4557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:06.667799 4557 webserver.cc:460] Webserver started at http://127.10.191.131:39907/ using document root <none> and password file <none>
I20260807 07:00:06.668481 4557 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:06.668612 4557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:06.669000 4557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:06.671739 4557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "9c6e042405db447da8ab86f2b696fcc5"
format_stamp: "Formatted at 2026-08-07 07:00:06 on dist-test-slave-tfpf"
server_key: "3b518f64180c9991817f6355409f7c80"
server_key_iv: "0f40a772942006a622f6b93c20b1ac15"
server_key_version: "encryptionkey@0"
I20260807 07:00:06.672515 4557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "9c6e042405db447da8ab86f2b696fcc5"
format_stamp: "Formatted at 2026-08-07 07:00:06 on dist-test-slave-tfpf"
server_key: "3b518f64180c9991817f6355409f7c80"
server_key_iv: "0f40a772942006a622f6b93c20b1ac15"
server_key_version: "encryptionkey@0"
I20260807 07:00:06.677516 4557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 07:00:06.680763 4575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:06.681908 4557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 07:00:06.682081 4557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "9c6e042405db447da8ab86f2b696fcc5"
format_stamp: "Formatted at 2026-08-07 07:00:06 on dist-test-slave-tfpf"
server_key: "3b518f64180c9991817f6355409f7c80"
server_key_iv: "0f40a772942006a622f6b93c20b1ac15"
server_key_version: "encryptionkey@0"
I20260807 07:00:06.682281 4557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:06.698843 4557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:06.699637 4557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:06.699936 4557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:06.700845 4557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:06.702273 4557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:06.702390 4557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:06.702514 4557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:06.702597 4557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:06.735060 4557 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:39527
I20260807 07:00:06.735137 4748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:39527 every 8 connection(s)
I20260807 07:00:06.736357 4557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 07:00:06.740114 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 4557
I20260807 07:00:06.740295 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 07:00:06.740870 11006 external_mini_cluster.cc:1428] Setting key 117ba54e3226b3bbab55497f6ab556aa
I20260807 07:00:06.748718 4366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.738838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:55457 (local address 127.10.191.190:44093)
0807 07:00:06.739025 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.739029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.740462 (+ 1433us) server_negotiation.cc:407] Connection header received
0807 07:00:06.742414 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.742418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.742512 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.742619 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:06.743980 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.744693 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.746216 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.746649 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.746760 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.748097 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:06.748101 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:06.748104 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:06.748121 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:06.748149 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:06.748160 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:06.748224 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.748415 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.748486 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 07:00:06.749668 4754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.739315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:44093 (local address 127.10.191.131:55457)
0807 07:00:06.740296 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:06.740352 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:06.742095 (+ 1743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:06.743074 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:06.743089 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:06.743211 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:06.743811 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.743835 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.744820 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.744823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.746084 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.746096 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.746846 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.746851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.747036 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.747787 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 07:00:06.747790 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:06.747824 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 07:00:06.747915 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:06.748242 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:06.748250 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:06.748255 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 07:00:06.748387 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 07:00:06.748640 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":244,"threads_started":1}
I20260807 07:00:06.750878 4750 heartbeater.cc:347] Connected to a master server at 127.10.191.190:44093
I20260807 07:00:06.751123 4750 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:06.751742 4750 heartbeater.cc:511] Master 127.10.191.190:44093 requested a full tablet report, sending...
I20260807 07:00:06.752990 4069 ts_manager.cc:194] Registered new tserver with Master: 9c6e042405db447da8ab86f2b696fcc5 (127.10.191.131:39527)
I20260807 07:00:06.753819 4069 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.131:55457
I20260807 07:00:06.756043 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 07:00:06.765169 4366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.760099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34128 (local address 127.10.191.190:44093)
0807 07:00:06.760239 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.760242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.760693 (+ 451us) server_negotiation.cc:407] Connection header received
0807 07:00:06.760808 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.760811 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.760869 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.760943 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:06.761388 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.761960 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.763149 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.763512 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.763602 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.764608 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:06.764612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:06.764615 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:06.764628 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:06.764652 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:06.764662 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:06.764723 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.764837 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.764896 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 07:00:06.768494 4069 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:00:06.774788 4069 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:00:06.799345 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.786439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:36995 (local address 127.0.0.1:38454)
0807 07:00:06.787420 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:06.787465 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:06.787685 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:06.790006 (+ 2321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:06.790017 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:06.790060 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:06.790568 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.790582 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.792601 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.792608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.795498 (+ 2890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.795517 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.798020 (+ 2503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.798028 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.798344 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.798413 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 07:00:06.798526 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 07:00:06.798793 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":25,"thread_start_us":901,"threads_started":1}
I20260807 07:00:06.802126 4771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.787149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38454 (local address 127.10.191.130:36995)
0807 07:00:06.789507 (+ 2358us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.789513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.789554 (+ 41us) server_negotiation.cc:407] Connection header received
0807 07:00:06.789636 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.789641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.789798 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.789936 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:06.790783 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.792420 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.795724 (+ 3304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.797715 (+ 1991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.801028 (+ 3313us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.801352 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.801435 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.801661 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2166,"thread_start_us":2072,"threads_started":1}
I20260807 07:00:06.802217 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.786754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45024 (local address 127.10.191.131:39527)
0807 07:00:06.788304 (+ 1550us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.788309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.790619 (+ 2310us) server_negotiation.cc:407] Connection header received
0807 07:00:06.790901 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.790908 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.791103 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.791320 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:06.792351 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.794241 (+ 1890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.798237 (+ 3996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.800096 (+ 1859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.800381 (+ 285us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.800677 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.801476 (+ 799us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.801727 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1402,"thread_start_us":1284,"threads_started":1}
I20260807 07:00:06.804746 4769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.786604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39527 (local address 127.0.0.1:45024)
0807 07:00:06.790506 (+ 3902us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:06.790521 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:06.790664 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:06.791637 (+ 973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:06.791644 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:06.791691 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:06.792129 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.792143 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.794507 (+ 2364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.794515 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.797961 (+ 3446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.797981 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.800913 (+ 2932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.800923 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.801205 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.801259 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 07:00:06.803612 (+ 2353us) client_negotiation.cc:240] Negotiation successful
0807 07:00:06.803807 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3788,"mutex_wait_us":4,"thread_start_us":3673,"threads_started":1}
I20260807 07:00:06.806347 4469 tablet_service.cc:1467] Processing CreateTablet for tablet 682f50f7e07748dc90ed196f09ad7d18 (DEFAULT_TABLE table=test-table [id=fe8f6c7daa434ba5bdaf5e40552ce6b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:06.807936 4469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 682f50f7e07748dc90ed196f09ad7d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:06.810072 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.791080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36763 (local address 127.0.0.1:38760)
0807 07:00:06.800648 (+ 9568us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:06.800669 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:06.800785 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:06.804607 (+ 3822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:06.804612 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:06.804635 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:06.804779 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.804788 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.806734 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.806743 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.808178 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.808199 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.809447 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.809452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.809630 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.809658 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 07:00:06.809715 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 07:00:06.809826 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9445,"thread_start_us":15706,"threads_started":1}
I20260807 07:00:06.810475 4655 tablet_service.cc:1467] Processing CreateTablet for tablet 682f50f7e07748dc90ed196f09ad7d18 (DEFAULT_TABLE table=test-table [id=fe8f6c7daa434ba5bdaf5e40552ce6b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:06.811007 4774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.791349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38760 (local address 127.10.191.129:36763)
0807 07:00:06.803891 (+ 12542us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.803898 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.803925 (+ 27us) server_negotiation.cc:407] Connection header received
0807 07:00:06.804020 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.804027 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.804215 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.804937 (+ 722us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:06.805177 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.806533 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.808338 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.809266 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.810436 (+ 1170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.810617 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.810664 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.810771 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12381,"thread_start_us":12994,"threads_started":1}
I20260807 07:00:06.811880 4655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 682f50f7e07748dc90ed196f09ad7d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:06.814143 4263 tablet_service.cc:1467] Processing CreateTablet for tablet 682f50f7e07748dc90ed196f09ad7d18 (DEFAULT_TABLE table=test-table [id=fe8f6c7daa434ba5bdaf5e40552ce6b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:06.815186 4263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 682f50f7e07748dc90ed196f09ad7d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:06.823459 4775 tablet_bootstrap.cc:492] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: Bootstrap starting.
I20260807 07:00:06.826121 4777 tablet_bootstrap.cc:492] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: Bootstrap starting.
I20260807 07:00:06.827404 4775 tablet_bootstrap.cc:654] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:06.827479 4780 tablet_bootstrap.cc:492] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a: Bootstrap starting.
I20260807 07:00:06.828927 4775 log.cc:824] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:06.829733 4777 tablet_bootstrap.cc:654] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:06.830912 4777 log.cc:824] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:06.831727 4780 tablet_bootstrap.cc:654] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:06.832273 4775 tablet_bootstrap.cc:492] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: No bootstrap required, opened a new log
I20260807 07:00:06.832580 4775 ts_tablet_manager.cc:1397] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 07:00:06.833330 4780 log.cc:824] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:06.840711 4777 tablet_bootstrap.cc:492] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: No bootstrap required, opened a new log
I20260807 07:00:06.841048 4777 ts_tablet_manager.cc:1397] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260807 07:00:06.843012 4775 raft_consensus.cc:348] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } }
I20260807 07:00:06.843463 4775 raft_consensus.cc:374] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:06.843580 4775 raft_consensus.cc:729] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 628a3327b5b04834a0b9e85ac1639d1a, State: Initialized, Role: FOLLOWER
I20260807 07:00:06.844340 4775 consensus_queue.cc:260] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } }
I20260807 07:00:06.845607 4554 heartbeater.cc:503] Master 127.10.191.190:44093 was elected leader, sending a full tablet report...
I20260807 07:00:06.846128 4775 ts_tablet_manager.cc:1428] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260807 07:00:06.847718 4780 tablet_bootstrap.cc:492] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a: No bootstrap required, opened a new log
I20260807 07:00:06.847993 4780 ts_tablet_manager.cc:1397] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.009s
I20260807 07:00:06.851227 4777 raft_consensus.cc:348] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } }
I20260807 07:00:06.851540 4777 raft_consensus.cc:374] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:06.851626 4777 raft_consensus.cc:729] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c6e042405db447da8ab86f2b696fcc5, State: Initialized, Role: FOLLOWER
I20260807 07:00:06.852239 4777 consensus_queue.cc:260] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } }
I20260807 07:00:06.853276 4750 heartbeater.cc:503] Master 127.10.191.190:44093 was elected leader, sending a full tablet report...
I20260807 07:00:06.853686 4777 ts_tablet_manager.cc:1428] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: Time spent starting tablet: real 0.012s user 0.009s sys 0.002s
I20260807 07:00:06.855943 4780 raft_consensus.cc:348] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } }
I20260807 07:00:06.856364 4780 raft_consensus.cc:374] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:06.856475 4780 raft_consensus.cc:729] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85b02884dcd54a298870aff0f2f4962a, State: Initialized, Role: FOLLOWER
I20260807 07:00:06.857107 4363 heartbeater.cc:503] Master 127.10.191.190:44093 was elected leader, sending a full tablet report...
I20260807 07:00:06.857095 4780 consensus_queue.cc:260] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } }
I20260807 07:00:06.859063 4780 ts_tablet_manager.cc:1428] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260807 07:00:06.864351 4787 raft_consensus.cc:482] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:00:06.864552 4787 raft_consensus.cc:504] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } }
I20260807 07:00:06.866024 4787 leader_election.cc:288] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 628a3327b5b04834a0b9e85ac1639d1a (127.10.191.130:36995), 9c6e042405db447da8ab86f2b696fcc5 (127.10.191.131:39527)
I20260807 07:00:06.872829 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.866510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:33007 (local address 127.10.191.131:39527)
0807 07:00:06.866709 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.866717 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.867820 (+ 1103us) server_negotiation.cc:407] Connection header received
0807 07:00:06.868107 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.868112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.868172 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.868215 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:06.868937 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.869730 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.871278 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.871956 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.872122 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.872182 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.872508 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.872613 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 07:00:06.872834 4771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.866445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:41465 (local address 127.10.191.130:36995)
0807 07:00:06.866784 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.866793 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.867439 (+ 646us) server_negotiation.cc:407] Connection header received
0807 07:00:06.867737 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.867744 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.867832 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.867926 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:06.868600 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.869440 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.871284 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.871939 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.872082 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.872154 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.872474 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.872588 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260807 07:00:06.872978 4789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.866522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39527 (local address 127.10.191.129:33007)
0807 07:00:06.867725 (+ 1203us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:06.867741 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:06.867923 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:06.868355 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:06.868357 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:06.868394 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:06.868774 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.868786 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.869857 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.869860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.871105 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.871116 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.872203 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.872225 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.872355 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.872375 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 07:00:06.872471 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 07:00:06.872582 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"mutex_wait_us":16,"thread_start_us":833,"threads_started":1}
I20260807 07:00:06.873203 4788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.866459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:36995 (local address 127.10.191.129:41465)
0807 07:00:06.867321 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:06.867342 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:06.867577 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:06.868104 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:06.868109 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:06.868145 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:06.868456 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.868466 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.869562 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.869567 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.871090 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:06.871102 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.872116 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.872122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:06.872310 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.872348 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 07:00:06.872424 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 07:00:06.872543 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"mutex_wait_us":69,"thread_start_us":537,"threads_started":1}
I20260807 07:00:06.873749 4685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "682f50f7e07748dc90ed196f09ad7d18" candidate_uuid: "85b02884dcd54a298870aff0f2f4962a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c6e042405db447da8ab86f2b696fcc5" is_pre_election: true
I20260807 07:00:06.874006 4495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "682f50f7e07748dc90ed196f09ad7d18" candidate_uuid: "85b02884dcd54a298870aff0f2f4962a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "628a3327b5b04834a0b9e85ac1639d1a" is_pre_election: true
I20260807 07:00:06.874161 4685 raft_consensus.cc:2454] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b02884dcd54a298870aff0f2f4962a in term 0.
I20260807 07:00:06.874452 4495 raft_consensus.cc:2454] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85b02884dcd54a298870aff0f2f4962a in term 0.
I20260807 07:00:06.874790 4195 leader_election.cc:302] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b02884dcd54a298870aff0f2f4962a, 9c6e042405db447da8ab86f2b696fcc5; no voters:
I20260807 07:00:06.875147 4787 raft_consensus.cc:2781] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:00:06.875301 4787 raft_consensus.cc:482] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:00:06.875397 4787 raft_consensus.cc:3037] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:06.877586 4787 raft_consensus.cc:504] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } }
I20260807 07:00:06.878147 4787 leader_election.cc:288] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [CANDIDATE]: Term 1 election: Requested vote from peers 628a3327b5b04834a0b9e85ac1639d1a (127.10.191.130:36995), 9c6e042405db447da8ab86f2b696fcc5 (127.10.191.131:39527)
I20260807 07:00:06.878546 4685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "682f50f7e07748dc90ed196f09ad7d18" candidate_uuid: "85b02884dcd54a298870aff0f2f4962a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c6e042405db447da8ab86f2b696fcc5"
I20260807 07:00:06.878629 4495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "682f50f7e07748dc90ed196f09ad7d18" candidate_uuid: "85b02884dcd54a298870aff0f2f4962a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "628a3327b5b04834a0b9e85ac1639d1a"
I20260807 07:00:06.878715 4685 raft_consensus.cc:3037] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:06.878834 4495 raft_consensus.cc:3037] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:06.880863 4685 raft_consensus.cc:2454] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b02884dcd54a298870aff0f2f4962a in term 1.
I20260807 07:00:06.881175 4495 raft_consensus.cc:2454] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85b02884dcd54a298870aff0f2f4962a in term 1.
I20260807 07:00:06.881265 4195 leader_election.cc:302] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85b02884dcd54a298870aff0f2f4962a, 9c6e042405db447da8ab86f2b696fcc5; no voters:
I20260807 07:00:06.881546 4787 raft_consensus.cc:2781] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:06.881947 4787 raft_consensus.cc:686] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [term 1 LEADER]: Becoming Leader. State: Replica: 85b02884dcd54a298870aff0f2f4962a, State: Running, Role: LEADER
I20260807 07:00:06.882390 4787 consensus_queue.cc:237] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } }
I20260807 07:00:06.886817 4069 catalog_manager.cc:5495] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a reported cstate change: term changed from 0 to 1, leader changed from <none> to 85b02884dcd54a298870aff0f2f4962a (127.10.191.129). New cstate: current_term: 1 leader_uuid: "85b02884dcd54a298870aff0f2f4962a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85b02884dcd54a298870aff0f2f4962a" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 36763 } health_report { overall_health: HEALTHY } } }
I20260807 07:00:06.914479 4774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.909259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38764 (local address 127.10.191.129:36763)
0807 07:00:06.909467 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.909473 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.909537 (+ 64us) server_negotiation.cc:407] Connection header received
0807 07:00:06.909785 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.909789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.909882 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.910029 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:00:06.910395 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.911183 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.912520 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.912899 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.913023 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.913511 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:00:06.913946 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:00:06.914094 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.914167 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.914238 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 07:00:06.922300 4495 raft_consensus.cc:1261] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [term 1 FOLLOWER]: Refusing update from remote peer 85b02884dcd54a298870aff0f2f4962a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:06.922302 4685 raft_consensus.cc:1261] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [term 1 FOLLOWER]: Refusing update from remote peer 85b02884dcd54a298870aff0f2f4962a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:06.923298 4791 consensus_queue.cc:1035] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [LEADER]: Connected to new peer: Peer: permanent_uuid: "628a3327b5b04834a0b9e85ac1639d1a" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 36995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:06.923645 4787 consensus_queue.cc:1035] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c6e042405db447da8ab86f2b696fcc5" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:06.936105 4795 mvcc.cc:205] Tried to move back new op lower bound from 7315808284343939072 to 7315808284194275328. Current Snapshot: MvccSnapshot[applied={T|T < 7315808284343939072}]
I20260807 07:00:06.949990 4067 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:06.950310 4067 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:06.954067 4067 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b256f08d28274a12b789dd89e97438c7: Sending DeleteTablet for 3 replicas of tablet 682f50f7e07748dc90ed196f09ad7d18
I20260807 07:00:06.955097 4469 tablet_service.cc:1514] Processing DeleteTablet for tablet 682f50f7e07748dc90ed196f09ad7d18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:06 UTC) from {username='slave'} at 127.0.0.1:38454
I20260807 07:00:06.955220 4263 tablet_service.cc:1514] Processing DeleteTablet for tablet 682f50f7e07748dc90ed196f09ad7d18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:06 UTC) from {username='slave'} at 127.0.0.1:38760
I20260807 07:00:06.955899 4810 tablet_replica.cc:330] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: stopping tablet replica
I20260807 07:00:06.956105 4655 tablet_service.cc:1514] Processing DeleteTablet for tablet 682f50f7e07748dc90ed196f09ad7d18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:06 UTC) from {username='slave'} at 127.0.0.1:45024
I20260807 07:00:06.956450 4810 raft_consensus.cc:2229] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:06.956669 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 4176
I20260807 07:00:06.957178 4810 raft_consensus.cc:2258] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:06.959443 4810 ts_tablet_manager.cc:1905] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:06.975860 4810 ts_tablet_manager.cc:1918] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:06.976152 4810 log.cc:1196] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/682f50f7e07748dc90ed196f09ad7d18
I20260807 07:00:06.977314 4810 ts_tablet_manager.cc:1939] T 682f50f7e07748dc90ed196f09ad7d18 P 628a3327b5b04834a0b9e85ac1639d1a: Deleting consensus metadata
I20260807 07:00:06.980374 4047 catalog_manager.cc:4841] TS 628a3327b5b04834a0b9e85ac1639d1a (127.10.191.130:36995): tablet 682f50f7e07748dc90ed196f09ad7d18 (table test-table [id=fe8f6c7daa434ba5bdaf5e40552ce6b2]) successfully deleted
I20260807 07:00:06.981484 4774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:06.959086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38770 (local address 127.10.191.129:36763)
0807 07:00:06.959257 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:06.959263 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:06.967951 (+ 8688us) server_negotiation.cc:407] Connection header received
0807 07:00:06.968386 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:06.968391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:06.968494 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:06.968568 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:06.969349 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.970590 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.972778 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:06.977240 (+ 4462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:06.977356 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:06.979001 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:06.979014 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:06.979031 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:06.979831 (+ 800us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:06.979913 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:06.979943 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:06.980036 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:06.980913 (+ 877us) server_negotiation.cc:299] Negotiation successful
0807 07:00:06.981038 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 07:00:06.981935 4815 tablet_replica.cc:330] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: stopping tablet replica
I20260807 07:00:06.982537 4815 raft_consensus.cc:2229] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:06.982618 4356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:06.983228 4815 raft_consensus.cc:2258] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:06.985898 4815 ts_tablet_manager.cc:1905] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:06.992813 4815 ts_tablet_manager.cc:1918] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:06.992938 4815 log.cc:1196] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/682f50f7e07748dc90ed196f09ad7d18
I20260807 07:00:06.993427 4815 ts_tablet_manager.cc:1939] T 682f50f7e07748dc90ed196f09ad7d18 P 9c6e042405db447da8ab86f2b696fcc5: Deleting consensus metadata
I20260807 07:00:06.994987 4046 catalog_manager.cc:4841] TS 9c6e042405db447da8ab86f2b696fcc5 (127.10.191.131:39527): tablet 682f50f7e07748dc90ed196f09ad7d18 (table test-table [id=fe8f6c7daa434ba5bdaf5e40552ce6b2]) successfully deleted
I20260807 07:00:07.078526 4812 tablet_replica.cc:330] T 682f50f7e07748dc90ed196f09ad7d18 P 85b02884dcd54a298870aff0f2f4962a: stopping tablet replica
I20260807 07:00:07.078751 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 4176
W20260807 07:00:07.103351 4046 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.191.129:36763 (error 108)
I20260807 07:00:07.103432 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 4368
I20260807 07:00:07.105445 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:07.104957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36763 (local address 127.0.0.1:38784)
0807 07:00:07.105187 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:07.105294 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:36763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 07:00:07.105741 4046 catalog_manager.cc:4584] TS 85b02884dcd54a298870aff0f2f4962a (127.10.191.129:36763): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 682f50f7e07748dc90ed196f09ad7d18: Network error: Client connection negotiation failed: client connection to 127.10.191.129:36763: connect: Connection refused (error 111)
I20260807 07:00:07.110903 4771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:07.104341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38466 (local address 127.10.191.130:36995)
0807 07:00:07.104551 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:07.104558 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:07.104585 (+ 27us) server_negotiation.cc:407] Connection header received
0807 07:00:07.104791 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:07.104798 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:07.104921 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:07.105055 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:07.105696 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:07.106563 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:07.107963 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:07.108325 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:07.108409 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:07.109544 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:07.109553 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:07.109567 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:07.110123 (+ 556us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:07.110183 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:07.110231 (+ 48us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:07.110345 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:07.110457 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 07:00:07.110545 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 07:00:07.111610 4548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:07.159364 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:07.158927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36763 (local address 127.0.0.1:38796)
0807 07:00:07.159133 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:07.159222 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:36763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 07:00:07.160435 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:07.160071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36763 (local address 127.0.0.1:38810)
0807 07:00:07.160211 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:07.160276 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:36763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 07:00:07.195643 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 4368
I20260807 07:00:07.218361 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 4557
I20260807 07:00:07.220880 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:07.220452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36763 (local address 127.0.0.1:38812)
0807 07:00:07.220615 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:07.220710 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:36763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 07:00:07.221961 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:07.221629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36763 (local address 127.0.0.1:38816)
0807 07:00:07.221769 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:07.221835 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:36763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 07:00:07.225596 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:07.219271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45026 (local address 127.10.191.131:39527)
0807 07:00:07.219447 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:07.219451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:07.219469 (+ 18us) server_negotiation.cc:407] Connection header received
0807 07:00:07.219547 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:07.219550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:07.219625 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:07.219726 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:07.220086 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:07.221143 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:07.222651 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:07.223029 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:07.223120 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:07.224082 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:07.224090 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:07.224105 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:07.224685 (+ 580us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:07.224731 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:07.224750 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:07.224838 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:07.224966 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 07:00:07.225048 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 07:00:07.226326 4741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:07.302630 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:07.302048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36763 (local address 127.0.0.1:38832)
0807 07:00:07.302307 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:07.302421 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:36763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 07:00:07.303783 4768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:07.303307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:36763 (local address 127.0.0.1:38848)
0807 07:00:07.303523 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:07.303624 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.129:36763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260807 07:00:07.310863 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 4557
I20260807 07:00:07.339002 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 4024
I20260807 07:00:07.340018 4122 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:07.446058 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 4024
2026-08-07T07:00:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2733 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:07 dist-test-slave-tfpf krb5kdc[4829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:07 dist-test-slave-tfpf krb5kdc[4829](info): set up 2 sockets
Aug 07 07:00:07 dist-test-slave-tfpf krb5kdc[4829](info): commencing operation
krb5kdc: starting...
W20260807 07:00:08.723146 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:08 dist-test-slave-tfpf krb5kdc[4829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:00:09.012209 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:46375
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:36733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:46375
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:09.344739 4844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:09.345098 4844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:09.345278 4844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:09.351887 4844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:09.352041 4844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:09.352144 4844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:09.352254 4844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:09.352331 4844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:09.361277 4844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:36733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:46375
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:46375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:09.362525 4844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:09.363793 4844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:09.375854 4854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:09.375792 4855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:09.375885 4858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:09.377225 4844 server_base.cc:1034] running on GCE node
I20260807 07:00:09.378021 4844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:09.379326 4844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:09.380546 4844 hybrid_clock.cc:648] HybridClock initialized: now 1786086009380494 us; error 53 us; skew 500 ppm
I20260807 07:00:09.380945 4844 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:09 dist-test-slave-tfpf krb5kdc[4829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086009, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:09.384027 4844 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:00:09.385567 4844 webserver.cc:460] Webserver started at http://127.10.191.190:37093/ using document root <none> and password file <none>
I20260807 07:00:09.386225 4844 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:09.386390 4844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:09.386759 4844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:09.389850 4844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2"
format_stamp: "Formatted at 2026-08-07 07:00:09 on dist-test-slave-tfpf"
server_key: "9a40b0e83bc3b0ab1da147dd2cb783ab"
server_key_iv: "67d1c90eeb8f2e415fb211e97946c6d3"
server_key_version: "encryptionkey@0"
I20260807 07:00:09.390653 4844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2"
format_stamp: "Formatted at 2026-08-07 07:00:09 on dist-test-slave-tfpf"
server_key: "9a40b0e83bc3b0ab1da147dd2cb783ab"
server_key_iv: "67d1c90eeb8f2e415fb211e97946c6d3"
server_key_version: "encryptionkey@0"
I20260807 07:00:09.396440 4844 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 07:00:09.400193 4868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:09.401595 4844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 07:00:09.401793 4844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2"
format_stamp: "Formatted at 2026-08-07 07:00:09 on dist-test-slave-tfpf"
server_key: "9a40b0e83bc3b0ab1da147dd2cb783ab"
server_key_iv: "67d1c90eeb8f2e415fb211e97946c6d3"
server_key_version: "encryptionkey@0"
I20260807 07:00:09.402014 4844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:09.414352 4844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:09.418416 4844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:09.418725 4844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:09.436704 4844 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:46375
I20260807 07:00:09.436721 4935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:46375 every 8 connection(s)
I20260807 07:00:09.438141 4844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:09.440348 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 4844
I20260807 07:00:09.440554 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:09.441229 11006 external_mini_cluster.cc:1428] Setting key b06a9ac211e99a81378b6df7069da981
I20260807 07:00:09.442656 4937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 07:00:09 dist-test-slave-tfpf krb5kdc[4829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:09.455744 4937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2: Bootstrap starting.
I20260807 07:00:09.459074 4937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:09.460073 4937 log.cc:824] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:09.463291 4937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2: No bootstrap required, opened a new log
I20260807 07:00:09.464051 4940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:09.443110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46808 (local address 127.10.191.190:46375)
0807 07:00:09.443812 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:09.443826 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:09.443874 (+ 48us) server_negotiation.cc:407] Connection header received
0807 07:00:09.445982 (+ 2108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:09.446007 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:09.446471 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:09.446921 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:09.448265 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:09.450201 (+ 1936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:09.451449 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:09.452400 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:09.452588 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:09.456974 (+ 4386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:09.456982 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:09.456993 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:09.457027 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:09.460032 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:09.461005 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:09.461014 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:09.461025 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:09.461268 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:09.461745 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:09.461748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:09.461750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:09.462177 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:09.462377 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:09.462855 (+ 478us) server_negotiation.cc:299] Negotiation successful
0807 07:00:09.463106 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":278,"threads_started":1}
I20260807 07:00:09.470345 4937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46375 } }
I20260807 07:00:09.470679 4937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:09.470793 4937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3444c7da623f44a3bf8e50b8c4ff7bd2, State: Initialized, Role: FOLLOWER
I20260807 07:00:09.471328 4937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46375 } }
I20260807 07:00:09.471575 4937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:09.471722 4937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:09.471899 4937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:09.473922 4937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46375 } }
I20260807 07:00:09.474421 4937 leader_election.cc:302] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3444c7da623f44a3bf8e50b8c4ff7bd2; no voters:
I20260807 07:00:09.475006 4937 leader_election.cc:288] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:09.475142 4942 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:09.475836 4942 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 3444c7da623f44a3bf8e50b8c4ff7bd2, State: Running, Role: LEADER
I20260807 07:00:09.476367 4942 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46375 } }
I20260807 07:00:09.477126 4937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:09.479151 4944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46375 } } }
I20260807 07:00:09.479561 4944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:09.479133 4945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3444c7da623f44a3bf8e50b8c4ff7bd2. Latest consensus state: current_term: 1 leader_uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3444c7da623f44a3bf8e50b8c4ff7bd2" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46375 } } }
I20260807 07:00:09.480122 4945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:09.483192 4953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:09.488692 4953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:09.497182 4953 catalog_manager.cc:1347] Generated new cluster ID: 1838e55204254c328623e2d3d9786cef
I20260807 07:00:09.497291 4953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:09.526491 4953 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:09.528031 4953 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:09.539655 4953 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2: Generated new TSK 0
I20260807 07:00:09.540380 4953 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 07:00:09.613420 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46375
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:36733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:09.960459 4977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:09.960757 4977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:09.960856 4977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:09.968173 4977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:09.968271 4977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:09.968384 4977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 07:00:09.977722 4977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:36733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46375
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:09.978977 4977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:09.980350 4977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:09.994086 4984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:09.994141 4983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:09.994153 4986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:09.995023 4977 server_base.cc:1034] running on GCE node
I20260807 07:00:09.995702 4977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:09.996767 4977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:09.998032 4977 hybrid_clock.cc:648] HybridClock initialized: now 1786086009997948 us; error 70 us; skew 500 ppm
I20260807 07:00:09.998395 4977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:09 dist-test-slave-tfpf krb5kdc[4829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086009, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:10.001747 4977 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 07:00:10.003372 4977 webserver.cc:460] Webserver started at http://127.10.191.129:42933/ using document root <none> and password file <none>
I20260807 07:00:10.004108 4977 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:10.004284 4977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:10.004645 4977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:10.007761 4977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "74fc6dd0a93f4fb6aa92fca055613259"
format_stamp: "Formatted at 2026-08-07 07:00:10 on dist-test-slave-tfpf"
server_key: "db10f949348e0d3532ca32d057c4f570"
server_key_iv: "3df84f49b672ffb1befaa8b9bfc9d871"
server_key_version: "encryptionkey@0"
I20260807 07:00:10.008571 4977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "74fc6dd0a93f4fb6aa92fca055613259"
format_stamp: "Formatted at 2026-08-07 07:00:10 on dist-test-slave-tfpf"
server_key: "db10f949348e0d3532ca32d057c4f570"
server_key_iv: "3df84f49b672ffb1befaa8b9bfc9d871"
server_key_version: "encryptionkey@0"
I20260807 07:00:10.013954 4977 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 07:00:10.017475 4994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:10.018704 4977 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 07:00:10.018896 4977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "74fc6dd0a93f4fb6aa92fca055613259"
format_stamp: "Formatted at 2026-08-07 07:00:10 on dist-test-slave-tfpf"
server_key: "db10f949348e0d3532ca32d057c4f570"
server_key_iv: "3df84f49b672ffb1befaa8b9bfc9d871"
server_key_version: "encryptionkey@0"
I20260807 07:00:10.019109 4977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:10.045555 4977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:10.049587 4977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:10.049903 4977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:10.050859 4977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:10.052259 4977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:10.052378 4977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:10.052536 4977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:10.052616 4977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:10.086529 4977 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:39523
I20260807 07:00:10.086589 5159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:39523 every 8 connection(s)
I20260807 07:00:10.087987 4977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 07:00:10.091439 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 4977
I20260807 07:00:10.091688 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 07:00:10.092262 11006 external_mini_cluster.cc:1428] Setting key f13ad3631ea4271f18e018fa7deedf5a
Aug 07 07:00:10 dist-test-slave-tfpf krb5kdc[4829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086009, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:10.110388 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:10.090664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:41211 (local address 127.10.191.190:46375)
0807 07:00:10.091171 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:10.091175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:10.092168 (+ 993us) server_negotiation.cc:407] Connection header received
0807 07:00:10.094131 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:10.094137 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:10.094237 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:10.094354 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:10.096375 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:10.097252 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:10.099526 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:10.099908 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:10.100023 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:10.103847 (+ 3824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:10.103852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:10.103855 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:10.103889 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:10.107008 (+ 3119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:10.107795 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:10.107802 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:10.107806 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:10.107955 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:10.108433 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:10.108440 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:10.108446 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:10.108747 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:10.108935 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:10.109699 (+ 764us) server_negotiation.cc:299] Negotiation successful
0807 07:00:10.109945 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":273,"threads_started":1}
I20260807 07:00:10.111279 5164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:10.091204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:46375 (local address 127.10.191.129:41211)
0807 07:00:10.092018 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:10.092064 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:10.093823 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:10.094613 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:10.094623 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:10.095391 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:10.096188 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:10.096215 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:10.097430 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:10.097439 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:10.099377 (+ 1938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:10.099399 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:10.100129 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:10.100138 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:10.100420 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:10.101128 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:00:10.101158 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:10.103633 (+ 2475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:10.107160 (+ 3527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:10.107169 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:10.107184 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:10.107649 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:10.108084 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:10.108089 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:10.108093 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:10.108290 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:10.108895 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:10.108903 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:10.109303 (+ 400us) client_negotiation.cc:769] Sending connection context
0807 07:00:10.109596 (+ 293us) client_negotiation.cc:240] Negotiation successful
0807 07:00:10.110096 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":357,"threads_started":1}
I20260807 07:00:10.113046 5160 heartbeater.cc:347] Connected to a master server at 127.10.191.190:46375
I20260807 07:00:10.113422 5160 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:10.114207 5160 heartbeater.cc:511] Master 127.10.191.190:46375 requested a full tablet report, sending...
I20260807 07:00:10.116546 4895 ts_manager.cc:194] Registered new tserver with Master: 74fc6dd0a93f4fb6aa92fca055613259 (127.10.191.129:39523)
I20260807 07:00:10.118185 4895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:41211
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 07:00:10.159523 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46375
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:36733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:10.490999 5167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:10.491263 5167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:10.491426 5167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:10.498483 5167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:10.498647 5167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:10.498857 5167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 07:00:10.509076 5167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:36733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46375
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:10.510325 5167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:10.511689 5167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:10.525290 5176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:10.525231 5178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:10.525701 5173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:10.526218 5167 server_base.cc:1034] running on GCE node
I20260807 07:00:10.526814 5167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:10.527833 5167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:10.529112 5167 hybrid_clock.cc:648] HybridClock initialized: now 1786086010529022 us; error 63 us; skew 500 ppm
I20260807 07:00:10.529407 5167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:10 dist-test-slave-tfpf krb5kdc[4829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086010, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:10.532414 5167 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 07:00:10.533730 5167 webserver.cc:460] Webserver started at http://127.10.191.130:46463/ using document root <none> and password file <none>
I20260807 07:00:10.534359 5167 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:10.534461 5167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:10.534709 5167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:10.537596 5167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "7bb7a32c7f4e4bba820c6983888c0035"
format_stamp: "Formatted at 2026-08-07 07:00:10 on dist-test-slave-tfpf"
server_key: "bb345c36ca3af072663b23ce952116c4"
server_key_iv: "eee0ede994fde42dbd04f5763d606163"
server_key_version: "encryptionkey@0"
I20260807 07:00:10.538372 5167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "7bb7a32c7f4e4bba820c6983888c0035"
format_stamp: "Formatted at 2026-08-07 07:00:10 on dist-test-slave-tfpf"
server_key: "bb345c36ca3af072663b23ce952116c4"
server_key_iv: "eee0ede994fde42dbd04f5763d606163"
server_key_version: "encryptionkey@0"
I20260807 07:00:10.543363 5167 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 07:00:10.546690 5188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:10.547977 5167 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 07:00:10.548151 5167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "7bb7a32c7f4e4bba820c6983888c0035"
format_stamp: "Formatted at 2026-08-07 07:00:10 on dist-test-slave-tfpf"
server_key: "bb345c36ca3af072663b23ce952116c4"
server_key_iv: "eee0ede994fde42dbd04f5763d606163"
server_key_version: "encryptionkey@0"
I20260807 07:00:10.548354 5167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:10.563608 5167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:10.567070 5167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:10.567363 5167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:10.568272 5167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:10.569566 5167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:10.569669 5167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:10.569831 5167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:10.569904 5167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:10.603595 5167 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:40707
I20260807 07:00:10.603639 5353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:40707 every 8 connection(s)
I20260807 07:00:10.605119 5167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 07:00:10.606137 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 5167
I20260807 07:00:10.606335 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 07:00:10.606904 11006 external_mini_cluster.cc:1428] Setting key 911e761ce010da584c1109e4bf0b3cee
Aug 07 07:00:10 dist-test-slave-tfpf krb5kdc[4829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086010, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:10.629333 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:10.608190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:60909 (local address 127.10.191.190:46375)
0807 07:00:10.608395 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:10.608401 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:10.609862 (+ 1461us) server_negotiation.cc:407] Connection header received
0807 07:00:10.612772 (+ 2910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:10.612776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:10.612839 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:10.612924 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:10.615042 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:10.615737 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:10.618235 (+ 2498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:10.618656 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:10.618755 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:10.622943 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:10.622951 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:10.622959 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:10.623004 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:10.625991 (+ 2987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:10.626816 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:10.626820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:10.626822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:10.626956 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:10.627430 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:10.627434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:10.627436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:10.627852 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:10.628014 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:10.628716 (+ 702us) server_negotiation.cc:299] Negotiation successful
0807 07:00:10.628964 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 07:00:10.630277 5356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:10.608792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:46375 (local address 127.10.191.130:60909)
0807 07:00:10.609681 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:10.609730 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:10.612476 (+ 2746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:10.613214 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:10.613227 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:10.614033 (+ 806us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:10.614855 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:10.614883 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:10.615903 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:10.615911 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:10.618096 (+ 2185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:10.618114 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:10.618886 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:10.618895 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:10.619209 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:10.619953 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:00:10.619986 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:10.622686 (+ 2700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:10.626137 (+ 3451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:10.626149 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:10.626164 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:10.626669 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:10.627078 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:10.627083 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:10.627088 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:10.627293 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:10.627987 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:10.627994 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:10.628325 (+ 331us) client_negotiation.cc:769] Sending connection context
0807 07:00:10.628588 (+ 263us) client_negotiation.cc:240] Negotiation successful
0807 07:00:10.629158 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":317,"threads_started":1}
I20260807 07:00:10.631886 5354 heartbeater.cc:347] Connected to a master server at 127.10.191.190:46375
I20260807 07:00:10.632191 5354 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:10.632911 5354 heartbeater.cc:511] Master 127.10.191.190:46375 requested a full tablet report, sending...
I20260807 07:00:10.634469 4895 ts_manager.cc:194] Registered new tserver with Master: 7bb7a32c7f4e4bba820c6983888c0035 (127.10.191.130:40707)
I20260807 07:00:10.635653 4895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:60909
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 07:00:10.676261 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46375
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:36733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:11.005686 5364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:11.005952 5364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:11.006042 5364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:11.012907 5364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:11.012993 5364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:11.013147 5364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 07:00:11.021999 5364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:36733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46375
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:11.023090 5364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:11.024375 5364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:11.037154 5376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:11.037343 5371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:11.037531 5372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:11.038319 5364 server_base.cc:1034] running on GCE node
I20260807 07:00:11.038833 5364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:11.039645 5364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:11.040833 5364 hybrid_clock.cc:648] HybridClock initialized: now 1786086011040781 us; error 54 us; skew 500 ppm
I20260807 07:00:11.041182 5364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:11 dist-test-slave-tfpf krb5kdc[4829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086011, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:11.044170 5364 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 07:00:11.045635 5364 webserver.cc:460] Webserver started at http://127.10.191.131:44745/ using document root <none> and password file <none>
I20260807 07:00:11.046298 5364 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:11.046424 5364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:11.046749 5364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:11.049624 5364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "35f19cb5158b4112b4702abf2b6ce8fc"
format_stamp: "Formatted at 2026-08-07 07:00:11 on dist-test-slave-tfpf"
server_key: "84ca9c3f0a9fad67daee5db271e153ac"
server_key_iv: "dd4c938e38eeb1333a8cff3f86d9e7ba"
server_key_version: "encryptionkey@0"
I20260807 07:00:11.050431 5364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "35f19cb5158b4112b4702abf2b6ce8fc"
format_stamp: "Formatted at 2026-08-07 07:00:11 on dist-test-slave-tfpf"
server_key: "84ca9c3f0a9fad67daee5db271e153ac"
server_key_iv: "dd4c938e38eeb1333a8cff3f86d9e7ba"
server_key_version: "encryptionkey@0"
I20260807 07:00:11.055393 5364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 07:00:11.058684 5383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:11.059921 5364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 07:00:11.060101 5364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "35f19cb5158b4112b4702abf2b6ce8fc"
format_stamp: "Formatted at 2026-08-07 07:00:11 on dist-test-slave-tfpf"
server_key: "84ca9c3f0a9fad67daee5db271e153ac"
server_key_iv: "dd4c938e38eeb1333a8cff3f86d9e7ba"
server_key_version: "encryptionkey@0"
I20260807 07:00:11.060315 5364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:11.088760 5364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:11.092990 5364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:11.093335 5364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:11.094221 5364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:11.095479 5364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:11.095605 5364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:11.095757 5364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:11.095844 5364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:11.121140 5160 heartbeater.cc:503] Master 127.10.191.190:46375 was elected leader, sending a full tablet report...
I20260807 07:00:11.128820 5364 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:34671
I20260807 07:00:11.128895 5544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:34671 every 8 connection(s)
I20260807 07:00:11.130167 5364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 07:00:11.136358 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 5364
I20260807 07:00:11.136566 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 07:00:11.137013 11006 external_mini_cluster.cc:1428] Setting key aee0b61520b5874df0c477985bcb7986
Aug 07 07:00:11 dist-test-slave-tfpf krb5kdc[4829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086011, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:11.149223 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.132627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:39469 (local address 127.10.191.190:46375)
0807 07:00:11.133037 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.133041 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.134044 (+ 1003us) server_negotiation.cc:407] Connection header received
0807 07:00:11.135865 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.135871 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.135985 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.136131 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:11.137771 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.138640 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.140065 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.140443 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.140579 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.143739 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:11.143744 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:11.143747 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:11.143778 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:11.146227 (+ 2449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.146918 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.146923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.146925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.147047 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.147494 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.147498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.147500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.147762 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:11.147936 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.148609 (+ 673us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.148821 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":207,"threads_started":1}
I20260807 07:00:11.149950 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.133231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:46375 (local address 127.10.191.131:39469)
0807 07:00:11.133890 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:11.133927 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:11.135560 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:11.136327 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:11.136335 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:11.136966 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:11.137589 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.137607 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.138813 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.138817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.139928 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.139940 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.140661 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.140671 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.140886 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.141543 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:00:11.141565 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:11.143523 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:11.146372 (+ 2849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:11.146381 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:11.146393 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:11.146782 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:11.147166 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:11.147171 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:11.147175 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:11.147361 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:11.147921 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:11.147928 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:11.148257 (+ 329us) client_negotiation.cc:769] Sending connection context
0807 07:00:11.148491 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 07:00:11.148925 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":266,"threads_started":1}
I20260807 07:00:11.151268 5545 heartbeater.cc:347] Connected to a master server at 127.10.191.190:46375
I20260807 07:00:11.151613 5545 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:11.152295 5545 heartbeater.cc:511] Master 127.10.191.190:46375 requested a full tablet report, sending...
I20260807 07:00:11.153757 4895 ts_manager.cc:194] Registered new tserver with Master: 35f19cb5158b4112b4702abf2b6ce8fc (127.10.191.131:34671)
I20260807 07:00:11.154532 4895 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:39469
I20260807 07:00:11.163820 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 07:00:11.180402 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.167793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46814 (local address 127.10.191.190:46375)
0807 07:00:11.168011 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.168020 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.168369 (+ 349us) server_negotiation.cc:407] Connection header received
0807 07:00:11.168496 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.168500 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.168557 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.168637 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:11.170094 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.170771 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.172097 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.172494 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.172588 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.175343 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:11.175347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:11.175350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:11.175378 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:11.177838 (+ 2460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.178623 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.178626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.178629 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.178733 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.179133 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.179136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.179138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.179410 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:11.179599 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.179920 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.180047 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 07:00:11.184036 4895 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46814:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:00:11.190722 4895 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:00:11.214213 5564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.202095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:40707 (local address 127.0.0.1:56978)
0807 07:00:11.202938 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:11.202984 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:11.203193 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:11.204576 (+ 1383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:11.204588 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:11.204655 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:11.205189 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.205208 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.208011 (+ 2803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.208021 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.211002 (+ 2981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.211024 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.213190 (+ 2166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.213197 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.213398 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.213462 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 07:00:11.213646 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 07:00:11.213812 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":343,"threads_started":1}
I20260807 07:00:11.215531 5565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.202341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56978 (local address 127.10.191.130:40707)
0807 07:00:11.203815 (+ 1474us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.203827 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.203861 (+ 34us) server_negotiation.cc:407] Connection header received
0807 07:00:11.203988 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.203999 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.204274 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.205446 (+ 1172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:11.205732 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.207812 (+ 2080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.211276 (+ 3464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.212930 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.214799 (+ 1869us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.214979 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.215055 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.215220 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1303,"thread_start_us":1174,"threads_started":1}
I20260807 07:00:11.219149 5568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.202822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:34671 (local address 127.0.0.1:35272)
0807 07:00:11.210757 (+ 7935us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:11.210781 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:11.210899 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:11.211703 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:11.211707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:11.211739 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:11.212259 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.212272 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.214234 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.214242 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.216365 (+ 2123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.216381 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.218398 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.218405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.218585 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.218616 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 07:00:11.218716 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 07:00:11.218834 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7797,"thread_start_us":9176,"threads_started":1}
I20260807 07:00:11.219432 5569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.203435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35272 (local address 127.10.191.131:34671)
0807 07:00:11.209840 (+ 6405us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.209848 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.211032 (+ 1184us) server_negotiation.cc:407] Connection header received
0807 07:00:11.211138 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.211147 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.211376 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.211607 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:11.212480 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.214042 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.216547 (+ 2505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.218033 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.218204 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.218372 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.218791 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.218966 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6245,"thread_start_us":6099,"threads_started":1}
I20260807 07:00:11.220127 5567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.203225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:39523 (local address 127.0.0.1:44344)
0807 07:00:11.212325 (+ 9100us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:11.212342 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:11.212535 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:11.213050 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:11.213054 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:11.213100 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:11.213601 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.213615 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.215402 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.215405 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.217188 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.217204 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.219339 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.219344 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.219541 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.219578 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 07:00:11.219682 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 07:00:11.219822 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8968,"thread_start_us":7251,"threads_started":1}
I20260807 07:00:11.219552 5260 tablet_service.cc:1467] Processing CreateTablet for tablet a720dffbc5a042508b633dd49af66109 (DEFAULT_TABLE table=test-table [id=b147e21980984ed48fb288465bae3cb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:11.220257 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.203870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44344 (local address 127.10.191.129:39523)
0807 07:00:11.210269 (+ 6399us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.210281 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.212435 (+ 2154us) server_negotiation.cc:407] Connection header received
0807 07:00:11.212706 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.212712 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.212877 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.213056 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:11.213814 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.215248 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.217376 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.218801 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.218969 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.219137 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.219763 (+ 626us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.219924 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6194,"thread_start_us":6024,"threads_started":1}
I20260807 07:00:11.221040 5260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a720dffbc5a042508b633dd49af66109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:11.223349 5452 tablet_service.cc:1467] Processing CreateTablet for tablet a720dffbc5a042508b633dd49af66109 (DEFAULT_TABLE table=test-table [id=b147e21980984ed48fb288465bae3cb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:11.223727 5069 tablet_service.cc:1467] Processing CreateTablet for tablet a720dffbc5a042508b633dd49af66109 (DEFAULT_TABLE table=test-table [id=b147e21980984ed48fb288465bae3cb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:11.224803 5452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a720dffbc5a042508b633dd49af66109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:11.224929 5069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a720dffbc5a042508b633dd49af66109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:11.236084 5572 tablet_bootstrap.cc:492] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: Bootstrap starting.
I20260807 07:00:11.238003 5574 tablet_bootstrap.cc:492] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: Bootstrap starting.
I20260807 07:00:11.239405 5575 tablet_bootstrap.cc:492] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: Bootstrap starting.
I20260807 07:00:11.240146 5572 tablet_bootstrap.cc:654] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:11.241539 5574 tablet_bootstrap.cc:654] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:11.241523 5572 log.cc:824] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:11.242625 5574 log.cc:824] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:11.242940 5575 tablet_bootstrap.cc:654] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:11.244158 5575 log.cc:824] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:11.244526 5572 tablet_bootstrap.cc:492] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: No bootstrap required, opened a new log
I20260807 07:00:11.244869 5572 ts_tablet_manager.cc:1397] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260807 07:00:11.245690 5574 tablet_bootstrap.cc:492] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: No bootstrap required, opened a new log
I20260807 07:00:11.245971 5574 ts_tablet_manager.cc:1397] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260807 07:00:11.246769 5575 tablet_bootstrap.cc:492] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: No bootstrap required, opened a new log
I20260807 07:00:11.247017 5575 ts_tablet_manager.cc:1397] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260807 07:00:11.254161 5575 raft_consensus.cc:348] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } }
I20260807 07:00:11.254576 5575 raft_consensus.cc:374] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:11.254747 5575 raft_consensus.cc:729] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35f19cb5158b4112b4702abf2b6ce8fc, State: Initialized, Role: FOLLOWER
I20260807 07:00:11.255203 5572 raft_consensus.cc:348] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } }
I20260807 07:00:11.255360 5575 consensus_queue.cc:260] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } }
I20260807 07:00:11.255609 5572 raft_consensus.cc:374] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:11.255717 5572 raft_consensus.cc:729] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74fc6dd0a93f4fb6aa92fca055613259, State: Initialized, Role: FOLLOWER
I20260807 07:00:11.256002 5574 raft_consensus.cc:348] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } }
I20260807 07:00:11.256459 5545 heartbeater.cc:503] Master 127.10.191.190:46375 was elected leader, sending a full tablet report...
I20260807 07:00:11.256510 5574 raft_consensus.cc:374] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:11.256488 5572 consensus_queue.cc:260] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } }
I20260807 07:00:11.256745 5574 raft_consensus.cc:729] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bb7a32c7f4e4bba820c6983888c0035, State: Initialized, Role: FOLLOWER
I20260807 07:00:11.257144 5575 ts_tablet_manager.cc:1428] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: Time spent starting tablet: real 0.010s user 0.010s sys 0.001s
I20260807 07:00:11.257638 5574 consensus_queue.cc:260] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } }
I20260807 07:00:11.258859 5354 heartbeater.cc:503] Master 127.10.191.190:46375 was elected leader, sending a full tablet report...
I20260807 07:00:11.259644 5574 ts_tablet_manager.cc:1428] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: Time spent starting tablet: real 0.014s user 0.008s sys 0.005s
I20260807 07:00:11.261173 5572 ts_tablet_manager.cc:1428] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
W20260807 07:00:11.340662 5161 tablet.cc:2369] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 07:00:11.357321 5355 tablet.cc:2369] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 07:00:11.381826 5547 tablet.cc:2369] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:00:11.409154 5581 raft_consensus.cc:482] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:00:11.409456 5581 raft_consensus.cc:504] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } }
I20260807 07:00:11.411175 5581 leader_election.cc:288] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bb7a32c7f4e4bba820c6983888c0035 (127.10.191.130:40707), 74fc6dd0a93f4fb6aa92fca055613259 (127.10.191.129:39523)
I20260807 07:00:11.416791 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.411520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:40707 (local address 127.10.191.131:34893)
0807 07:00:11.411747 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:11.411768 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:11.411888 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:11.412357 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:11.412362 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:11.412393 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:11.412594 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.412603 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.413705 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.413710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.414904 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.414927 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.416036 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.416042 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.416227 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.416250 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 07:00:11.416357 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 07:00:11.416487 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":25}
I20260807 07:00:11.416785 5565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.411762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:34893 (local address 127.10.191.130:40707)
0807 07:00:11.412018 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.412024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.412045 (+ 21us) server_negotiation.cc:407] Connection header received
0807 07:00:11.412120 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.412127 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.412223 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.412324 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:11.412751 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.413540 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.415087 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.415874 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.416043 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.416119 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.416386 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.416512 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260807 07:00:11.417748 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.412060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:34583 (local address 127.10.191.129:39523)
0807 07:00:11.412251 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.412258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.412691 (+ 433us) server_negotiation.cc:407] Connection header received
0807 07:00:11.412877 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.412888 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.412946 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.413042 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:11.413623 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.414269 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.415962 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.416763 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.416951 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.417023 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.417370 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.417495 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 07:00:11.417835 5585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.411901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:39523 (local address 127.10.191.131:34583)
0807 07:00:11.412572 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:11.412585 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:11.412726 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:11.413091 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:11.413096 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:11.413122 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:11.413450 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.413458 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.414419 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.414425 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.415790 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:11.415802 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.416965 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.416971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:11.417194 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.417237 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 07:00:11.417342 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 07:00:11.417459 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"mutex_wait_us":3,"thread_start_us":361,"threads_started":1}
I20260807 07:00:11.418025 5286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a720dffbc5a042508b633dd49af66109" candidate_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bb7a32c7f4e4bba820c6983888c0035" is_pre_election: true
I20260807 07:00:11.418560 5286 raft_consensus.cc:2454] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35f19cb5158b4112b4702abf2b6ce8fc in term 0.
I20260807 07:00:11.418781 5093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a720dffbc5a042508b633dd49af66109" candidate_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74fc6dd0a93f4fb6aa92fca055613259" is_pre_election: true
I20260807 07:00:11.419243 5389 leader_election.cc:302] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35f19cb5158b4112b4702abf2b6ce8fc, 7bb7a32c7f4e4bba820c6983888c0035; no voters:
I20260807 07:00:11.419260 5093 raft_consensus.cc:2454] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35f19cb5158b4112b4702abf2b6ce8fc in term 0.
I20260807 07:00:11.419638 5581 raft_consensus.cc:2781] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:00:11.419829 5581 raft_consensus.cc:482] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:00:11.419961 5581 raft_consensus.cc:3037] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:11.422199 5581 raft_consensus.cc:504] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } }
I20260807 07:00:11.422792 5581 leader_election.cc:288] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [CANDIDATE]: Term 1 election: Requested vote from peers 7bb7a32c7f4e4bba820c6983888c0035 (127.10.191.130:40707), 74fc6dd0a93f4fb6aa92fca055613259 (127.10.191.129:39523)
I20260807 07:00:11.423352 5286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a720dffbc5a042508b633dd49af66109" candidate_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bb7a32c7f4e4bba820c6983888c0035"
I20260807 07:00:11.423413 5093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a720dffbc5a042508b633dd49af66109" candidate_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74fc6dd0a93f4fb6aa92fca055613259"
I20260807 07:00:11.423565 5286 raft_consensus.cc:3037] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:11.423667 5093 raft_consensus.cc:3037] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:11.426091 5286 raft_consensus.cc:2454] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35f19cb5158b4112b4702abf2b6ce8fc in term 1.
I20260807 07:00:11.426107 5093 raft_consensus.cc:2454] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35f19cb5158b4112b4702abf2b6ce8fc in term 1.
I20260807 07:00:11.426492 5389 leader_election.cc:302] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35f19cb5158b4112b4702abf2b6ce8fc, 74fc6dd0a93f4fb6aa92fca055613259; no voters:
I20260807 07:00:11.426795 5581 raft_consensus.cc:2781] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:11.427245 5581 raft_consensus.cc:686] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 1 LEADER]: Becoming Leader. State: Replica: 35f19cb5158b4112b4702abf2b6ce8fc, State: Running, Role: LEADER
I20260807 07:00:11.427709 5581 consensus_queue.cc:237] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } }
I20260807 07:00:11.432482 4895 catalog_manager.cc:5495] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 35f19cb5158b4112b4702abf2b6ce8fc (127.10.191.131). New cstate: current_term: 1 leader_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35f19cb5158b4112b4702abf2b6ce8fc" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 34671 } health_report { overall_health: HEALTHY } } }
I20260807 07:00:11.458511 5569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.453662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35288 (local address 127.10.191.131:34671)
0807 07:00:11.453868 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.453872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.453889 (+ 17us) server_negotiation.cc:407] Connection header received
0807 07:00:11.454038 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.454041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.454107 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.454223 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:00:11.454584 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.455213 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.456385 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.456791 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.456887 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.457436 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:00:11.457913 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:00:11.458040 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.458218 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.458268 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 07:00:11.466317 5286 raft_consensus.cc:1261] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [term 1 FOLLOWER]: Refusing update from remote peer 35f19cb5158b4112b4702abf2b6ce8fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:11.466320 5093 raft_consensus.cc:1261] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [term 1 FOLLOWER]: Refusing update from remote peer 35f19cb5158b4112b4702abf2b6ce8fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:11.467303 5586 consensus_queue.cc:1035] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74fc6dd0a93f4fb6aa92fca055613259" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 39523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:11.467660 5581 consensus_queue.cc:1035] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bb7a32c7f4e4bba820c6983888c0035" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 40707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:11.480345 5591 mvcc.cc:205] Tried to move back new op lower bound from 7315808302955552768 to 7315808302811426816. Current Snapshot: MvccSnapshot[applied={T|T < 7315808302955552768}]
I20260807 07:00:11.484194 5590 mvcc.cc:205] Tried to move back new op lower bound from 7315808302955552768 to 7315808302811426816. Current Snapshot: MvccSnapshot[applied={T|T < 7315808302955552768}]
I20260807 07:00:11.492538 4892 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:11.492856 4892 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:11.496317 4892 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3444c7da623f44a3bf8e50b8c4ff7bd2: Sending DeleteTablet for 3 replicas of tablet a720dffbc5a042508b633dd49af66109
I20260807 07:00:11.497453 5260 tablet_service.cc:1514] Processing DeleteTablet for tablet a720dffbc5a042508b633dd49af66109 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:11 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:56978
I20260807 07:00:11.497524 5452 tablet_service.cc:1514] Processing DeleteTablet for tablet a720dffbc5a042508b633dd49af66109 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:11 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:35272
I20260807 07:00:11.497519 5069 tablet_service.cc:1514] Processing DeleteTablet for tablet a720dffbc5a042508b633dd49af66109 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:11 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:44344
I20260807 07:00:11.502408 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 4977
I20260807 07:00:11.510097 5601 tablet_replica.cc:330] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: stopping tablet replica
I20260807 07:00:11.510558 5601 raft_consensus.cc:2229] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:11.511089 5601 raft_consensus.cc:2258] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:11.513379 5601 ts_tablet_manager.cc:1905] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:11.520309 5601 ts_tablet_manager.cc:1918] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:11.520525 5601 log.cc:1196] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/a720dffbc5a042508b633dd49af66109
I20260807 07:00:11.521202 5601 ts_tablet_manager.cc:1939] T a720dffbc5a042508b633dd49af66109 P 7bb7a32c7f4e4bba820c6983888c0035: Deleting consensus metadata
I20260807 07:00:11.523241 4873 catalog_manager.cc:4841] TS 7bb7a32c7f4e4bba820c6983888c0035 (127.10.191.130:40707): tablet a720dffbc5a042508b633dd49af66109 (table test-table [id=b147e21980984ed48fb288465bae3cb2]) successfully deleted
I20260807 07:00:11.528399 5603 tablet_replica.cc:330] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: stopping tablet replica
I20260807 07:00:11.528829 5603 raft_consensus.cc:2229] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:00:11.529539 5603 raft_consensus.cc:2258] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:11.532029 5603 ts_tablet_manager.cc:1905] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:11.533851 5604 tablet_replica.cc:330] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: stopping tablet replica
I20260807 07:00:11.534251 5604 raft_consensus.cc:2229] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:11.534744 5604 raft_consensus.cc:2258] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:11.536707 5604 ts_tablet_manager.cc:1905] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:11.539427 5603 ts_tablet_manager.cc:1918] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:11.539639 5603 log.cc:1196] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/a720dffbc5a042508b633dd49af66109
I20260807 07:00:11.540208 5603 ts_tablet_manager.cc:1939] T a720dffbc5a042508b633dd49af66109 P 35f19cb5158b4112b4702abf2b6ce8fc: Deleting consensus metadata
Aug 07 07:00:11 dist-test-slave-tfpf krb5kdc[4829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 07:00:11.541983 4871 catalog_manager.cc:4841] TS 35f19cb5158b4112b4702abf2b6ce8fc (127.10.191.131:34671): tablet a720dffbc5a042508b633dd49af66109 (table test-table [id=b147e21980984ed48fb288465bae3cb2]) successfully deleted
I20260807 07:00:11.543394 5604 ts_tablet_manager.cc:1918] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:11.543587 5604 log.cc:1196] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/a720dffbc5a042508b633dd49af66109
I20260807 07:00:11.544050 5604 ts_tablet_manager.cc:1939] T a720dffbc5a042508b633dd49af66109 P 74fc6dd0a93f4fb6aa92fca055613259: Deleting consensus metadata
I20260807 07:00:11.545399 4873 catalog_manager.cc:4841] TS 74fc6dd0a93f4fb6aa92fca055613259 (127.10.191.129:39523): tablet a720dffbc5a042508b633dd49af66109 (table test-table [id=b147e21980984ed48fb288465bae3cb2]) successfully deleted
I20260807 07:00:11.548410 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.503415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44350 (local address 127.10.191.129:39523)
0807 07:00:11.503565 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.503571 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.525602 (+ 22031us) server_negotiation.cc:407] Connection header received
0807 07:00:11.525893 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.525899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.525984 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.526057 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:11.529984 (+ 3927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.531195 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.535106 (+ 3911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.535743 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.535860 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.541592 (+ 5732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:11.541608 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:11.541632 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:11.541689 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:11.545545 (+ 3856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.546221 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.546230 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.546234 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.546404 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.546783 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.546788 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.546792 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.547246 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:11.547549 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.547770 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.548005 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 07:00:11.549129 5154 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:11.642925 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 4977
I20260807 07:00:11.672093 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 5167
Aug 07 07:00:11 dist-test-slave-tfpf krb5kdc[4829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 07:00:11.689976 5565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.672920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56994 (local address 127.10.191.130:40707)
0807 07:00:11.673159 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.673164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.673184 (+ 20us) server_negotiation.cc:407] Connection header received
0807 07:00:11.673390 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.673394 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.673458 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.673543 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:11.675275 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.676023 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.678025 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.678762 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.678915 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.684001 (+ 5086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:11.684015 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:11.684030 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:11.684069 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:11.687055 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.687775 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.687783 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.687785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.687913 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.688333 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.688337 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.688339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.688745 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:11.689043 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.689397 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.689656 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 07:00:11.690616 5347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:11.830550 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 5167
I20260807 07:00:11.854787 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 5364
Aug 07 07:00:11 dist-test-slave-tfpf krb5kdc[4829](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 07:00:11.872653 5569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:11.855677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35298 (local address 127.10.191.131:34671)
0807 07:00:11.855900 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:11.855906 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:11.855932 (+ 26us) server_negotiation.cc:407] Connection header received
0807 07:00:11.856020 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:11.856026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:11.856121 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:11.856246 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:11.857642 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.858923 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.860200 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:11.860955 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:11.861161 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:11.865612 (+ 4451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:11.865629 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:11.865659 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:11.865702 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:11.869650 (+ 3948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.870278 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.870294 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.870298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.870503 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:11.870900 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:11.870908 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:11.870916 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:11.871420 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:11.871738 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:11.871958 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 07:00:11.872210 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 07:00:11.873499 5539 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:12.007130 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 5364
I20260807 07:00:12.035467 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 4844
I20260807 07:00:12.036530 4931 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:12.142110 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 4844
2026-08-07T07:00:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4696 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T07:00:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:12Z Disabled control of system clock
I20260807 07:00:12.241364 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:46259
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:44347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:46259
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 07:00:12.569468 5616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:12.569743 5616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:12.569897 5616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:12.576756 5616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:12.576856 5616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:12.576939 5616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:12.577054 5616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:12.577149 5616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:12.585573 5616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:46259
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:46259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:12.586740 5616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:12.588560 5616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:12.599925 5622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:12.599869 5623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:12.600401 5625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:12.600782 5616 server_base.cc:1034] running on GCE node
I20260807 07:00:12.601617 5616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:12.602923 5616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:12.604133 5616 hybrid_clock.cc:648] HybridClock initialized: now 1786086012604086 us; error 37 us; skew 500 ppm
I20260807 07:00:12.604446 5616 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:12.606719 5616 webserver.cc:460] Webserver started at http://127.10.191.190:42837/ using document root <none> and password file <none>
I20260807 07:00:12.607388 5616 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:12.607477 5616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:12.607750 5616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:12.610656 5616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "49c39493b53b40ee9b21560ac867139a"
format_stamp: "Formatted at 2026-08-07 07:00:12 on dist-test-slave-tfpf"
server_key: "f8e0eedb681d8fb13d25e7a8c06d36f8"
server_key_iv: "8bd4a9f17363e8acd270f4680e316655"
server_key_version: "encryptionkey@0"
I20260807 07:00:12.611387 5616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "49c39493b53b40ee9b21560ac867139a"
format_stamp: "Formatted at 2026-08-07 07:00:12 on dist-test-slave-tfpf"
server_key: "f8e0eedb681d8fb13d25e7a8c06d36f8"
server_key_iv: "8bd4a9f17363e8acd270f4680e316655"
server_key_version: "encryptionkey@0"
I20260807 07:00:12.616299 5616 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260807 07:00:12.619670 5635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:12.620883 5616 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 07:00:12.621033 5616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "49c39493b53b40ee9b21560ac867139a"
format_stamp: "Formatted at 2026-08-07 07:00:12 on dist-test-slave-tfpf"
server_key: "f8e0eedb681d8fb13d25e7a8c06d36f8"
server_key_iv: "8bd4a9f17363e8acd270f4680e316655"
server_key_version: "encryptionkey@0"
I20260807 07:00:12.621256 5616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:12.639199 5616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:12.639829 5616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:12.640075 5616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:12.657820 5616 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:46259
I20260807 07:00:12.657864 5711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:46259 every 8 connection(s)
I20260807 07:00:12.659003 5616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:12.662355 5712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:12.666019 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 5616
I20260807 07:00:12.666200 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:12.666736 11006 external_mini_cluster.cc:1428] Setting key d2cac4f14237a59b170fcd82ea471cd2
I20260807 07:00:12.675031 5712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a: Bootstrap starting.
I20260807 07:00:12.678821 5712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:12.679879 5717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:12.668656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44212 (local address 127.10.191.190:46259)
0807 07:00:12.669617 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:12.669627 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:12.669666 (+ 39us) server_negotiation.cc:407] Connection header received
0807 07:00:12.671131 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:12.671151 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:12.671592 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:12.671900 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:12.672557 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:12.673813 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:12.675611 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:12.676238 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:12.676355 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:12.677726 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:12.677733 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:12.677745 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:12.678264 (+ 519us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:12.678356 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:12.678375 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:12.678455 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:12.678705 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 07:00:12.679000 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":402,"threads_started":1}
I20260807 07:00:12.679858 5712 log.cc:824] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:12.683001 5712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a: No bootstrap required, opened a new log
I20260807 07:00:12.690505 5712 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49c39493b53b40ee9b21560ac867139a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46259 } }
I20260807 07:00:12.690912 5712 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:12.691023 5712 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49c39493b53b40ee9b21560ac867139a, State: Initialized, Role: FOLLOWER
I20260807 07:00:12.691648 5712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49c39493b53b40ee9b21560ac867139a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46259 } }
I20260807 07:00:12.691906 5712 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:12.692062 5712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:12.692229 5712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:12.694701 5712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49c39493b53b40ee9b21560ac867139a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46259 } }
I20260807 07:00:12.695211 5712 leader_election.cc:302] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49c39493b53b40ee9b21560ac867139a; no voters:
I20260807 07:00:12.695825 5712 leader_election.cc:288] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:12.695968 5719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:12.696668 5719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [term 1 LEADER]: Becoming Leader. State: Replica: 49c39493b53b40ee9b21560ac867139a, State: Running, Role: LEADER
I20260807 07:00:12.697341 5719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49c39493b53b40ee9b21560ac867139a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46259 } }
I20260807 07:00:12.697970 5712 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:12.699990 5721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49c39493b53b40ee9b21560ac867139a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49c39493b53b40ee9b21560ac867139a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46259 } } }
I20260807 07:00:12.700318 5721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:12.702478 5729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:12.702450 5722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49c39493b53b40ee9b21560ac867139a. Latest consensus state: current_term: 1 leader_uuid: "49c39493b53b40ee9b21560ac867139a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49c39493b53b40ee9b21560ac867139a" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46259 } } }
I20260807 07:00:12.702791 5722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:12.708077 5729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:12.717950 5729 catalog_manager.cc:1347] Generated new cluster ID: bc0c9684823e42bbbec281a6c5e84067
I20260807 07:00:12.718086 5729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:12.731539 5729 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:12.733445 5729 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:12.744565 5729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a: Generated new TSK 0
I20260807 07:00:12.745481 5729 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:12.757027 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46259
--builtin_ntp_servers=127.10.191.148:44347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 07:00:13.106958 5749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:13.107303 5749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:13.107462 5749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:13.114461 5749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:13.114579 5749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:13.114738 5749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 07:00:13.123653 5749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46259
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:13.124949 5749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:13.126746 5749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:13.140568 5755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:13.140496 5760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:13.140506 5756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:13.141397 5749 server_base.cc:1034] running on GCE node
I20260807 07:00:13.141912 5749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:13.142727 5749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:13.143973 5749 hybrid_clock.cc:648] HybridClock initialized: now 1786086013143925 us; error 57 us; skew 500 ppm
I20260807 07:00:13.144359 5749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:13.146716 5749 webserver.cc:460] Webserver started at http://127.10.191.129:44651/ using document root <none> and password file <none>
I20260807 07:00:13.147428 5749 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:13.147549 5749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:13.147889 5749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:13.150713 5749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "63f2c72ceea2420da41bf1348dd9332c"
format_stamp: "Formatted at 2026-08-07 07:00:13 on dist-test-slave-tfpf"
server_key: "64af11f0ab6ec103cec33cb5cec0bd43"
server_key_iv: "5e03d48cc0c808d0a442c8f563e45c6f"
server_key_version: "encryptionkey@0"
I20260807 07:00:13.151489 5749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "63f2c72ceea2420da41bf1348dd9332c"
format_stamp: "Formatted at 2026-08-07 07:00:13 on dist-test-slave-tfpf"
server_key: "64af11f0ab6ec103cec33cb5cec0bd43"
server_key_iv: "5e03d48cc0c808d0a442c8f563e45c6f"
server_key_version: "encryptionkey@0"
I20260807 07:00:13.156527 5749 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 07:00:13.159827 5768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:13.161022 5749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 07:00:13.161274 5749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "63f2c72ceea2420da41bf1348dd9332c"
format_stamp: "Formatted at 2026-08-07 07:00:13 on dist-test-slave-tfpf"
server_key: "64af11f0ab6ec103cec33cb5cec0bd43"
server_key_iv: "5e03d48cc0c808d0a442c8f563e45c6f"
server_key_version: "encryptionkey@0"
I20260807 07:00:13.161490 5749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:13.175594 5749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:13.176323 5749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:13.176625 5749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:13.177640 5749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:13.179056 5749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:13.179195 5749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:13.179325 5749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:13.179416 5749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:13.212862 5749 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:42503
I20260807 07:00:13.212920 5918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:42503 every 8 connection(s)
I20260807 07:00:13.214197 5749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 07:00:13.215556 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 5749
I20260807 07:00:13.215746 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 07:00:13.216223 11006 external_mini_cluster.cc:1428] Setting key 4e853bda8144eb29e4e9169fe4ea9769
I20260807 07:00:13.219952 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46259
--builtin_ntp_servers=127.10.191.148:44347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 07:00:13.229981 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:13.217177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:50871 (local address 127.10.191.190:46259)
0807 07:00:13.218554 (+ 1377us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:13.218562 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:13.219416 (+ 854us) server_negotiation.cc:407] Connection header received
0807 07:00:13.222215 (+ 2799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:13.222218 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:13.222299 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:13.222389 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:13.223777 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:13.224620 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:13.227096 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:13.227490 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:13.227588 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:13.229209 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:13.229213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:13.229216 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:13.229246 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:13.229289 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:13.229300 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:13.229369 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:13.229629 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 07:00:13.229706 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1236,"thread_start_us":1137,"threads_started":1}
I20260807 07:00:13.231369 5923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:13.217584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:46259 (local address 127.10.191.129:50871)
0807 07:00:13.219231 (+ 1647us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:13.219297 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:13.221943 (+ 2646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:13.222676 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:13.222689 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:13.222809 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:13.223593 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:13.223620 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:13.224777 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:13.224785 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:13.226953 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:13.226971 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:13.227733 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:13.227743 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:13.228070 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:13.228807 (+ 737us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 07:00:13.228813 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:13.228866 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 07:00:13.228978 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:13.229400 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:13.229415 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:13.229425 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 07:00:13.229593 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 07:00:13.230023 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1103,"thread_start_us":875,"threads_started":1}
I20260807 07:00:13.232925 5919 heartbeater.cc:347] Connected to a master server at 127.10.191.190:46259
I20260807 07:00:13.233338 5919 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:13.234081 5919 heartbeater.cc:511] Master 127.10.191.190:46259 requested a full tablet report, sending...
I20260807 07:00:13.236088 5658 ts_manager.cc:194] Registered new tserver with Master: 63f2c72ceea2420da41bf1348dd9332c (127.10.191.129:42503)
I20260807 07:00:13.237701 5658 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.129:50871
W20260807 07:00:13.549163 5924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:13.549413 5924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:13.549566 5924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:13.556126 5924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:13.556218 5924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:13.556376 5924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 07:00:13.564436 5924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46259
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:13.565632 5924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:13.567426 5924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:13.579742 5936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:13.579818 5930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:13.579806 5933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:13.580654 5924 server_base.cc:1034] running on GCE node
I20260807 07:00:13.581404 5924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:13.582257 5924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:13.583480 5924 hybrid_clock.cc:648] HybridClock initialized: now 1786086013583446 us; error 53 us; skew 500 ppm
I20260807 07:00:13.583783 5924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:13.589726 5924 webserver.cc:460] Webserver started at http://127.10.191.130:43787/ using document root <none> and password file <none>
I20260807 07:00:13.590438 5924 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:13.590588 5924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:13.590996 5924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:13.594014 5924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "6ced90a931f14f6f8980d2393f3fb9f2"
format_stamp: "Formatted at 2026-08-07 07:00:13 on dist-test-slave-tfpf"
server_key: "be2c7d1d634fe9efe1155a306141a067"
server_key_iv: "6c4cf359d16ece26caa19f247fd5c805"
server_key_version: "encryptionkey@0"
I20260807 07:00:13.594844 5924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "6ced90a931f14f6f8980d2393f3fb9f2"
format_stamp: "Formatted at 2026-08-07 07:00:13 on dist-test-slave-tfpf"
server_key: "be2c7d1d634fe9efe1155a306141a067"
server_key_iv: "6c4cf359d16ece26caa19f247fd5c805"
server_key_version: "encryptionkey@0"
I20260807 07:00:13.599812 5924 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 07:00:13.603404 5948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:13.604737 5924 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260807 07:00:13.604903 5924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "6ced90a931f14f6f8980d2393f3fb9f2"
format_stamp: "Formatted at 2026-08-07 07:00:13 on dist-test-slave-tfpf"
server_key: "be2c7d1d634fe9efe1155a306141a067"
server_key_iv: "6c4cf359d16ece26caa19f247fd5c805"
server_key_version: "encryptionkey@0"
I20260807 07:00:13.605129 5924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:13.632439 5924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:13.633345 5924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:13.633656 5924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:13.634676 5924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:13.636021 5924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:13.636148 5924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:13.636266 5924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:13.636346 5924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:13.668294 5924 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:37637
I20260807 07:00:13.668322 6093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:37637 every 8 connection(s)
I20260807 07:00:13.669848 5924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 07:00:13.674962 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 5924
I20260807 07:00:13.675158 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 07:00:13.675706 11006 external_mini_cluster.cc:1428] Setting key 940657374965c3c5cb3f701a4b6b8a4d
I20260807 07:00:13.678766 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46259
--builtin_ntp_servers=127.10.191.148:44347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 07:00:13.683419 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:13.672600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:47619 (local address 127.10.191.190:46259)
0807 07:00:13.672780 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:13.672785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:13.674300 (+ 1515us) server_negotiation.cc:407] Connection header received
0807 07:00:13.676615 (+ 2315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:13.676620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:13.676726 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:13.676837 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:13.678290 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:13.679306 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:13.680709 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:13.681349 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:13.681478 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:13.682598 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:13.682606 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:13.682612 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:13.682633 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:13.682678 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:13.682693 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:13.682780 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:13.682961 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 07:00:13.683057 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 07:00:13.684199 6098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:13.673200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:46259 (local address 127.10.191.130:47619)
0807 07:00:13.674142 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:13.674191 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:13.676341 (+ 2150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:13.677263 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:13.677274 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:13.677379 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:13.678103 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:13.678131 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:13.679469 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:13.679473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:13.680565 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:13.680577 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:13.681527 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:13.681531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:13.681705 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:13.682335 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 07:00:13.682337 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:13.682370 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 07:00:13.682431 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:13.682784 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:13.682791 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:13.682796 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 07:00:13.682919 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 07:00:13.683170 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":318,"threads_started":1}
I20260807 07:00:13.685537 6095 heartbeater.cc:347] Connected to a master server at 127.10.191.190:46259
I20260807 07:00:13.685812 6095 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:13.686604 6095 heartbeater.cc:511] Master 127.10.191.190:46259 requested a full tablet report, sending...
I20260807 07:00:13.688189 5658 ts_manager.cc:194] Registered new tserver with Master: 6ced90a931f14f6f8980d2393f3fb9f2 (127.10.191.130:37637)
I20260807 07:00:13.689301 5658 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.130:47619
W20260807 07:00:14.013144 6100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:14.013545 6100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:14.013700 6100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:14.020272 6100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:14.020386 6100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:14.020576 6100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 07:00:14.028952 6100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:46259
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:14.030185 6100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:14.031901 6100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:14.044728 6108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:14.044775 6111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:14.044821 6107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:14.045624 6100 server_base.cc:1034] running on GCE node
I20260807 07:00:14.046258 6100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:14.047209 6100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:14.048446 6100 hybrid_clock.cc:648] HybridClock initialized: now 1786086014048394 us; error 63 us; skew 500 ppm
I20260807 07:00:14.048777 6100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:14.051074 6100 webserver.cc:460] Webserver started at http://127.10.191.131:44039/ using document root <none> and password file <none>
I20260807 07:00:14.051730 6100 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:14.051860 6100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:14.052170 6100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:14.054879 6100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "c26469efe7284072ae6a6b6337bb69b1"
format_stamp: "Formatted at 2026-08-07 07:00:14 on dist-test-slave-tfpf"
server_key: "d3ba2e2f787296a60ec7fdbdd99edbc7"
server_key_iv: "54d8b66e21a077a49dac0719adcf705f"
server_key_version: "encryptionkey@0"
I20260807 07:00:14.055658 6100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "c26469efe7284072ae6a6b6337bb69b1"
format_stamp: "Formatted at 2026-08-07 07:00:14 on dist-test-slave-tfpf"
server_key: "d3ba2e2f787296a60ec7fdbdd99edbc7"
server_key_iv: "54d8b66e21a077a49dac0719adcf705f"
server_key_version: "encryptionkey@0"
I20260807 07:00:14.060484 6100 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260807 07:00:14.063661 6118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:14.064839 6100 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 07:00:14.065022 6100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "c26469efe7284072ae6a6b6337bb69b1"
format_stamp: "Formatted at 2026-08-07 07:00:14 on dist-test-slave-tfpf"
server_key: "d3ba2e2f787296a60ec7fdbdd99edbc7"
server_key_iv: "54d8b66e21a077a49dac0719adcf705f"
server_key_version: "encryptionkey@0"
I20260807 07:00:14.065251 6100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:14.095736 6100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:14.096493 6100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:14.096817 6100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:14.097864 6100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:14.099417 6100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:14.099503 6100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:14.099581 6100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:14.099632 6100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:14.132251 6100 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:45447
I20260807 07:00:14.132340 6274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:45447 every 8 connection(s)
I20260807 07:00:14.133701 6100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 07:00:14.141980 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 6100
I20260807 07:00:14.142158 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 07:00:14.142697 11006 external_mini_cluster.cc:1428] Setting key f99004055258bc8c24edd797f3b4f1ed
I20260807 07:00:14.146992 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.136465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:35149 (local address 127.10.191.190:46259)
0807 07:00:14.136698 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.136705 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.138248 (+ 1543us) server_negotiation.cc:407] Connection header received
0807 07:00:14.139996 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.140001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.140092 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.140202 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:14.141258 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.142285 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.144276 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.144764 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.144902 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.146338 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:14.146343 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:14.146346 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:14.146362 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:14.146393 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:14.146404 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:14.146473 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.146672 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.146746 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 07:00:14.147887 6277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.137196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:46259 (local address 127.10.191.131:35149)
0807 07:00:14.138096 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:14.138138 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:14.139732 (+ 1594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:14.140427 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:14.140435 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:14.140514 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:14.141058 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.141124 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.142448 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.142452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.144136 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.144149 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.144986 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.144992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.145283 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.146069 (+ 786us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 07:00:14.146071 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:14.146106 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 07:00:14.146172 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:14.146485 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:14.146492 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:14.146497 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 07:00:14.146621 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 07:00:14.146866 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":277,"threads_started":1}
I20260807 07:00:14.149175 6275 heartbeater.cc:347] Connected to a master server at 127.10.191.190:46259
I20260807 07:00:14.149407 6275 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:14.150075 6275 heartbeater.cc:511] Master 127.10.191.190:46259 requested a full tablet report, sending...
I20260807 07:00:14.151351 5658 ts_manager.cc:194] Registered new tserver with Master: c26469efe7284072ae6a6b6337bb69b1 (127.10.191.131:45447)
I20260807 07:00:14.152024 5658 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.131:35149
I20260807 07:00:14.157984 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 07:00:14.167127 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.161866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44224 (local address 127.10.191.190:46259)
0807 07:00:14.162039 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.162043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.162500 (+ 457us) server_negotiation.cc:407] Connection header received
0807 07:00:14.162628 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.162631 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.162698 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.162775 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:14.163189 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.163781 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.165040 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.165494 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.165579 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.166552 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:14.166556 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:14.166559 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:14.166574 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:14.166601 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:14.166610 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:14.166709 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.166851 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.166890 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 07:00:14.170850 5658 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:00:14.177960 5658 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:00:14.202181 6290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.189136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:42503 (local address 127.0.0.1:53644)
0807 07:00:14.190471 (+ 1335us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:14.190509 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:14.190665 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:14.191721 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:14.191732 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:14.191772 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:14.192326 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.192341 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.194730 (+ 2389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.194738 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.198438 (+ 3700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.198460 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.201318 (+ 2858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.201330 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.201534 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.201603 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 07:00:14.201714 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 07:00:14.201889 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1109,"thread_start_us":1035,"threads_started":1}
I20260807 07:00:14.202507 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.189306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53644 (local address 127.10.191.129:42503)
0807 07:00:14.189972 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.189981 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.190624 (+ 643us) server_negotiation.cc:407] Connection header received
0807 07:00:14.190901 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.190911 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.191182 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.191391 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:14.192591 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.194507 (+ 1916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.198743 (+ 4236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.200684 (+ 1941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.200871 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.201163 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.201992 (+ 829us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.202172 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":511,"threads_started":1}
I20260807 07:00:14.208382 5836 tablet_service.cc:1467] Processing CreateTablet for tablet f4d5cfcbb19f438ba3b900ee13125814 (DEFAULT_TABLE table=test-table [id=ca32c9e54d174b0da1765a66abcd00e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:14.210039 5836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4d5cfcbb19f438ba3b900ee13125814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:14.211274 6293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.189369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:37637 (local address 127.0.0.1:40486)
0807 07:00:14.201528 (+ 12159us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:14.201546 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:14.201650 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:14.204938 (+ 3288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:14.204942 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:14.204965 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:14.205279 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.205289 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.206595 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.206601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.208631 (+ 2030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.208648 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.210537 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.210544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.210721 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.210756 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 07:00:14.210849 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 07:00:14.210972 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12034,"thread_start_us":12354,"threads_started":1}
I20260807 07:00:14.211431 6295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.189722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40486 (local address 127.10.191.130:37637)
0807 07:00:14.204217 (+ 14495us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.204225 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.204250 (+ 25us) server_negotiation.cc:407] Connection header received
0807 07:00:14.204352 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.204358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.204551 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.204723 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:14.205431 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.206459 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.208853 (+ 2394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.210314 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.210478 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.210672 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.210918 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.211088 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14340,"thread_start_us":14229,"threads_started":1}
I20260807 07:00:14.213773 6290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.190903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:45447 (local address 127.0.0.1:52948)
0807 07:00:14.202824 (+ 11921us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:14.202843 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:14.202939 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:14.203634 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:14.203638 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:14.203701 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:14.203878 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.203893 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.208243 (+ 4350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.208249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.209965 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.209978 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.211926 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.211932 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.212122 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.213158 (+ 1036us) client_negotiation.cc:769] Sending connection context
0807 07:00:14.213251 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 07:00:14.213383 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11640,"mutex_wait_us":24,"thread_start_us":13418,"threads_started":1}
I20260807 07:00:14.214532 6298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.191334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52948 (local address 127.10.191.131:45447)
0807 07:00:14.203167 (+ 11833us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.203172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.203196 (+ 24us) server_negotiation.cc:407] Connection header received
0807 07:00:14.203262 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.203267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.203470 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.203643 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:14.204067 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.205528 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.210115 (+ 4587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.211428 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.211612 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.211810 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.214059 (+ 2249us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.214213 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11684,"thread_start_us":11560,"threads_started":1}
I20260807 07:00:14.215339 6012 tablet_service.cc:1467] Processing CreateTablet for tablet f4d5cfcbb19f438ba3b900ee13125814 (DEFAULT_TABLE table=test-table [id=ca32c9e54d174b0da1765a66abcd00e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:14.216799 6012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4d5cfcbb19f438ba3b900ee13125814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:14.217900 6194 tablet_service.cc:1467] Processing CreateTablet for tablet f4d5cfcbb19f438ba3b900ee13125814 (DEFAULT_TABLE table=test-table [id=ca32c9e54d174b0da1765a66abcd00e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:14.219308 6194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4d5cfcbb19f438ba3b900ee13125814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:14.230890 6300 tablet_bootstrap.cc:492] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: Bootstrap starting.
I20260807 07:00:14.231616 6299 tablet_bootstrap.cc:492] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: Bootstrap starting.
I20260807 07:00:14.232779 6301 tablet_bootstrap.cc:492] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: Bootstrap starting.
I20260807 07:00:14.235196 6300 tablet_bootstrap.cc:654] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:14.236029 6299 tablet_bootstrap.cc:654] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:14.236400 6301 tablet_bootstrap.cc:654] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:14.236478 6300 log.cc:824] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:14.237143 6299 log.cc:824] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:14.237633 6301 log.cc:824] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:14.239825 6300 tablet_bootstrap.cc:492] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: No bootstrap required, opened a new log
I20260807 07:00:14.240089 6300 ts_tablet_manager.cc:1397] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260807 07:00:14.241137 6301 tablet_bootstrap.cc:492] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: No bootstrap required, opened a new log
I20260807 07:00:14.241405 6301 ts_tablet_manager.cc:1397] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260807 07:00:14.242261 5919 heartbeater.cc:503] Master 127.10.191.190:46259 was elected leader, sending a full tablet report...
I20260807 07:00:14.246766 6299 tablet_bootstrap.cc:492] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: No bootstrap required, opened a new log
I20260807 07:00:14.247052 6299 ts_tablet_manager.cc:1397] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.007s
I20260807 07:00:14.250828 6300 raft_consensus.cc:348] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } }
I20260807 07:00:14.251259 6300 raft_consensus.cc:374] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:14.251379 6300 raft_consensus.cc:729] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c26469efe7284072ae6a6b6337bb69b1, State: Initialized, Role: FOLLOWER
I20260807 07:00:14.251650 6301 raft_consensus.cc:348] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } }
I20260807 07:00:14.252050 6301 raft_consensus.cc:374] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:14.252147 6301 raft_consensus.cc:729] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ced90a931f14f6f8980d2393f3fb9f2, State: Initialized, Role: FOLLOWER
I20260807 07:00:14.252035 6300 consensus_queue.cc:260] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } }
I20260807 07:00:14.252823 6301 consensus_queue.cc:260] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } }
I20260807 07:00:14.253845 6275 heartbeater.cc:503] Master 127.10.191.190:46259 was elected leader, sending a full tablet report...
I20260807 07:00:14.254750 6300 ts_tablet_manager.cc:1428] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260807 07:00:14.255223 6299 raft_consensus.cc:348] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } }
I20260807 07:00:14.255548 6299 raft_consensus.cc:374] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:14.255654 6299 raft_consensus.cc:729] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f2c72ceea2420da41bf1348dd9332c, State: Initialized, Role: FOLLOWER
I20260807 07:00:14.256203 6299 consensus_queue.cc:260] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } }
I20260807 07:00:14.259521 6299 ts_tablet_manager.cc:1428] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: Time spent starting tablet: real 0.012s user 0.005s sys 0.009s
I20260807 07:00:14.260207 6095 heartbeater.cc:503] Master 127.10.191.190:46259 was elected leader, sending a full tablet report...
I20260807 07:00:14.261301 6301 ts_tablet_manager.cc:1428] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: Time spent starting tablet: real 0.020s user 0.014s sys 0.005s
I20260807 07:00:14.362883 6308 raft_consensus.cc:482] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:00:14.363215 6308 raft_consensus.cc:504] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } }
I20260807 07:00:14.364851 6308 leader_election.cc:288] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ced90a931f14f6f8980d2393f3fb9f2 (127.10.191.130:37637), c26469efe7284072ae6a6b6337bb69b1 (127.10.191.131:45447)
I20260807 07:00:14.372025 6295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.365184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:59737 (local address 127.10.191.130:37637)
0807 07:00:14.365753 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.365761 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.365848 (+ 87us) server_negotiation.cc:407] Connection header received
0807 07:00:14.366062 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.366066 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.366132 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.366222 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:14.366867 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.367792 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.370079 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.371069 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.371178 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.371240 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.371644 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.371768 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388}
I20260807 07:00:14.372083 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.365009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:37637 (local address 127.10.191.129:59737)
0807 07:00:14.365743 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:14.365767 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:14.365919 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:14.366252 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:14.366256 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:14.366312 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:14.366727 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.366744 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.367918 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.367923 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.369855 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.369869 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.371277 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.371285 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.371463 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.371513 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 07:00:14.371605 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 07:00:14.371734 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"mutex_wait_us":24,"thread_start_us":421,"threads_started":1}
I20260807 07:00:14.372442 6298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.365470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:43471 (local address 127.10.191.131:45447)
0807 07:00:14.365763 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.365770 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.366432 (+ 662us) server_negotiation.cc:407] Connection header received
0807 07:00:14.366582 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.366586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.366699 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.366789 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:14.367402 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.368368 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.370313 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.371477 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.371654 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.371728 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.372062 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.372208 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
I20260807 07:00:14.372718 6312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.365240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:45447 (local address 127.10.191.129:43471)
0807 07:00:14.366323 (+ 1083us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:14.366336 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:14.366476 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:14.366825 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:14.366829 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:14.366854 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:14.367230 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.367242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.368506 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.368510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.370139 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:14.370153 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.371706 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.371712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:14.371876 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.371911 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 07:00:14.372001 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 07:00:14.372148 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":956,"mutex_wait_us":1,"thread_start_us":792,"threads_started":1}
I20260807 07:00:14.373534 6036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d5cfcbb19f438ba3b900ee13125814" candidate_uuid: "63f2c72ceea2420da41bf1348dd9332c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" is_pre_election: true
I20260807 07:00:14.373842 6220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d5cfcbb19f438ba3b900ee13125814" candidate_uuid: "63f2c72ceea2420da41bf1348dd9332c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c26469efe7284072ae6a6b6337bb69b1" is_pre_election: true
I20260807 07:00:14.374145 6036 raft_consensus.cc:2454] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f2c72ceea2420da41bf1348dd9332c in term 0.
I20260807 07:00:14.374366 6220 raft_consensus.cc:2454] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f2c72ceea2420da41bf1348dd9332c in term 0.
I20260807 07:00:14.374864 5770 leader_election.cc:302] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f2c72ceea2420da41bf1348dd9332c, 6ced90a931f14f6f8980d2393f3fb9f2; no voters:
I20260807 07:00:14.375425 6308 raft_consensus.cc:2781] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:00:14.375537 6308 raft_consensus.cc:482] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:00:14.375633 6308 raft_consensus.cc:3037] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:14.377784 6308 raft_consensus.cc:504] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } }
I20260807 07:00:14.378439 6308 leader_election.cc:288] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [CANDIDATE]: Term 1 election: Requested vote from peers 6ced90a931f14f6f8980d2393f3fb9f2 (127.10.191.130:37637), c26469efe7284072ae6a6b6337bb69b1 (127.10.191.131:45447)
I20260807 07:00:14.378764 6036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d5cfcbb19f438ba3b900ee13125814" candidate_uuid: "63f2c72ceea2420da41bf1348dd9332c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ced90a931f14f6f8980d2393f3fb9f2"
I20260807 07:00:14.378930 6220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d5cfcbb19f438ba3b900ee13125814" candidate_uuid: "63f2c72ceea2420da41bf1348dd9332c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c26469efe7284072ae6a6b6337bb69b1"
I20260807 07:00:14.378978 6036 raft_consensus.cc:3037] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:14.379134 6220 raft_consensus.cc:3037] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:14.381222 6036 raft_consensus.cc:2454] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f2c72ceea2420da41bf1348dd9332c in term 1.
I20260807 07:00:14.381273 6220 raft_consensus.cc:2454] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f2c72ceea2420da41bf1348dd9332c in term 1.
I20260807 07:00:14.381587 5770 leader_election.cc:302] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f2c72ceea2420da41bf1348dd9332c, 6ced90a931f14f6f8980d2393f3fb9f2; no voters:
I20260807 07:00:14.381862 6308 raft_consensus.cc:2781] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:14.382266 6308 raft_consensus.cc:686] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 1 LEADER]: Becoming Leader. State: Replica: 63f2c72ceea2420da41bf1348dd9332c, State: Running, Role: LEADER
I20260807 07:00:14.382687 6308 consensus_queue.cc:237] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } }
W20260807 07:00:14.385456 6276 tablet.cc:2369] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:00:14.387260 5656 catalog_manager.cc:5495] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f2c72ceea2420da41bf1348dd9332c (127.10.191.129). New cstate: current_term: 1 leader_uuid: "63f2c72ceea2420da41bf1348dd9332c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f2c72ceea2420da41bf1348dd9332c" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20260807 07:00:14.418883 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.413728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53652 (local address 127.10.191.129:42503)
0807 07:00:14.413900 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.413904 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.414006 (+ 102us) server_negotiation.cc:407] Connection header received
0807 07:00:14.414181 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.414185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.414267 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.414385 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:00:14.414753 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.415452 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.416885 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.417362 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.417456 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.417949 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:00:14.418432 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:00:14.418565 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.418657 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.418692 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 07:00:14.422106 6097 tablet.cc:2369] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:00:14.426988 6036 raft_consensus.cc:1261] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [term 1 FOLLOWER]: Refusing update from remote peer 63f2c72ceea2420da41bf1348dd9332c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:14.426986 6220 raft_consensus.cc:1261] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [term 1 FOLLOWER]: Refusing update from remote peer 63f2c72ceea2420da41bf1348dd9332c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:14.428045 6308 consensus_queue.cc:1035] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ced90a931f14f6f8980d2393f3fb9f2" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:14.428372 6313 consensus_queue.cc:1035] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c26469efe7284072ae6a6b6337bb69b1" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:14.452772 5658 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:14.453038 5658 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:14.456353 5658 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 49c39493b53b40ee9b21560ac867139a: Sending DeleteTablet for 3 replicas of tablet f4d5cfcbb19f438ba3b900ee13125814
I20260807 07:00:14.457517 5836 tablet_service.cc:1514] Processing DeleteTablet for tablet f4d5cfcbb19f438ba3b900ee13125814 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:14 UTC) from {username='slave'} at 127.0.0.1:53644
I20260807 07:00:14.457595 6012 tablet_service.cc:1514] Processing DeleteTablet for tablet f4d5cfcbb19f438ba3b900ee13125814 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:14 UTC) from {username='slave'} at 127.0.0.1:40486
I20260807 07:00:14.458060 6194 tablet_service.cc:1514] Processing DeleteTablet for tablet f4d5cfcbb19f438ba3b900ee13125814 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:14 UTC) from {username='slave'} at 127.0.0.1:52948
I20260807 07:00:14.463083 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 5749
I20260807 07:00:14.474112 6333 tablet_replica.cc:330] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: stopping tablet replica
I20260807 07:00:14.474545 6333 raft_consensus.cc:2229] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:00:14.475214 6333 raft_consensus.cc:2258] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:14.479372 6333 ts_tablet_manager.cc:1905] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:14.487634 6333 ts_tablet_manager.cc:1918] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:14.487870 6333 log.cc:1196] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/f4d5cfcbb19f438ba3b900ee13125814
I20260807 07:00:14.488531 6333 ts_tablet_manager.cc:1939] T f4d5cfcbb19f438ba3b900ee13125814 P 63f2c72ceea2420da41bf1348dd9332c: Deleting consensus metadata
I20260807 07:00:14.489311 6335 tablet_replica.cc:330] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: stopping tablet replica
I20260807 07:00:14.489756 6335 raft_consensus.cc:2229] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:14.490283 6335 raft_consensus.cc:2258] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:14.490654 5636 catalog_manager.cc:4841] TS 63f2c72ceea2420da41bf1348dd9332c (127.10.191.129:42503): tablet f4d5cfcbb19f438ba3b900ee13125814 (table test-table [id=ca32c9e54d174b0da1765a66abcd00e5]) successfully deleted
I20260807 07:00:14.493049 6334 tablet_replica.cc:330] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: stopping tablet replica
I20260807 07:00:14.493410 6334 raft_consensus.cc:2229] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:14.493856 6334 raft_consensus.cc:2258] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:14.494442 6335 ts_tablet_manager.cc:1905] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:14.496160 6334 ts_tablet_manager.cc:1905] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:14.496371 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.464593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53660 (local address 127.10.191.129:42503)
0807 07:00:14.464828 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.464837 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.484230 (+ 19393us) server_negotiation.cc:407] Connection header received
0807 07:00:14.484810 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.484816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.484905 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.484985 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:14.485700 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.486834 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.491254 (+ 4420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.491706 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.491778 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.494577 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:14.494589 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:14.494606 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:14.495435 (+ 829us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:14.495495 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:14.495523 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:14.495648 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.495880 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.495985 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 07:00:14.497571 5912 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:14.502521 6335 ts_tablet_manager.cc:1918] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:14.502714 6335 log.cc:1196] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/f4d5cfcbb19f438ba3b900ee13125814
I20260807 07:00:14.503280 6335 ts_tablet_manager.cc:1939] T f4d5cfcbb19f438ba3b900ee13125814 P c26469efe7284072ae6a6b6337bb69b1: Deleting consensus metadata
I20260807 07:00:14.504784 6334 ts_tablet_manager.cc:1918] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:14.504961 6334 log.cc:1196] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/f4d5cfcbb19f438ba3b900ee13125814
I20260807 07:00:14.505137 5636 catalog_manager.cc:4841] TS c26469efe7284072ae6a6b6337bb69b1 (127.10.191.131:45447): tablet f4d5cfcbb19f438ba3b900ee13125814 (table test-table [id=ca32c9e54d174b0da1765a66abcd00e5]) successfully deleted
I20260807 07:00:14.505564 6334 ts_tablet_manager.cc:1939] T f4d5cfcbb19f438ba3b900ee13125814 P 6ced90a931f14f6f8980d2393f3fb9f2: Deleting consensus metadata
I20260807 07:00:14.507069 5637 catalog_manager.cc:4841] TS 6ced90a931f14f6f8980d2393f3fb9f2 (127.10.191.130:37637): tablet f4d5cfcbb19f438ba3b900ee13125814 (table test-table [id=ca32c9e54d174b0da1765a66abcd00e5]) successfully deleted
I20260807 07:00:14.590953 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 5749
I20260807 07:00:14.617650 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 5924
I20260807 07:00:14.623873 6295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.618513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40490 (local address 127.10.191.130:37637)
0807 07:00:14.618690 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.618695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.618713 (+ 18us) server_negotiation.cc:407] Connection header received
0807 07:00:14.618805 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.618809 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.618893 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.618990 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:14.619398 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.620095 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.621217 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.621625 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.621716 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.622637 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:14.622645 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:14.622658 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:14.623199 (+ 541us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:14.623245 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:14.623264 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:14.623344 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.623450 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.623534 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 07:00:14.624609 6088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:14.717869 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 5924
I20260807 07:00:14.742465 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 6100
I20260807 07:00:14.749533 6298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:14.743286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.10.191.131:45447)
0807 07:00:14.743492 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:14.743499 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:14.743520 (+ 21us) server_negotiation.cc:407] Connection header received
0807 07:00:14.743708 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:14.743712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:14.743799 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:14.743910 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:14.744338 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.745115 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.746386 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:14.746774 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:14.746913 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:14.748025 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:14.748034 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:14.748051 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:14.748623 (+ 572us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:14.748681 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:14.748701 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:14.748829 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:14.748963 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 07:00:14.749207 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 07:00:14.750202 6269 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:14.836020 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 6100
I20260807 07:00:14.857661 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 5616
I20260807 07:00:14.858709 5705 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:14.960623 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 5616
2026-08-07T07:00:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2817 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:15 dist-test-slave-tfpf krb5kdc[6344](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:15 dist-test-slave-tfpf krb5kdc[6344](info): set up 2 sockets
Aug 07 07:00:15 dist-test-slave-tfpf krb5kdc[6344](info): commencing operation
krb5kdc: starting...
W20260807 07:00:16.207289 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:16 dist-test-slave-tfpf krb5kdc[6344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:00:16.494028 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:41695
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:41695
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:16.820938 6366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:16.821273 6366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:16.821439 6366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:16.828256 6366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:16.828411 6366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:16.828516 6366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:16.828627 6366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:16.828703 6366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:16.837987 6366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:41695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:41695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:16.839201 6366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:16.840416 6366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:16.851819 6377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:16.851898 6375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:16.851931 6374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:16.852782 6366 server_base.cc:1034] running on GCE node
I20260807 07:00:16.853588 6366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:16.854849 6366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:16.856040 6366 hybrid_clock.cc:648] HybridClock initialized: now 1786086016855986 us; error 46 us; skew 500 ppm
I20260807 07:00:16.856353 6366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:16 dist-test-slave-tfpf krb5kdc[6344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086016, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:16.859408 6366 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:00:16.860762 6366 webserver.cc:460] Webserver started at http://127.10.191.190:36665/ using document root <none> and password file <none>
I20260807 07:00:16.861433 6366 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:16.861578 6366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:16.861864 6366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:16.864588 6366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "59a8be542a664051aef9f242883afc53"
format_stamp: "Formatted at 2026-08-07 07:00:16 on dist-test-slave-tfpf"
server_key: "9dcb95e6d416c92c20cd7c91f133310d"
server_key_iv: "7a7ab661f822257bb5b1f90e27bdb90b"
server_key_version: "encryptionkey@0"
I20260807 07:00:16.865343 6366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "59a8be542a664051aef9f242883afc53"
format_stamp: "Formatted at 2026-08-07 07:00:16 on dist-test-slave-tfpf"
server_key: "9dcb95e6d416c92c20cd7c91f133310d"
server_key_iv: "7a7ab661f822257bb5b1f90e27bdb90b"
server_key_version: "encryptionkey@0"
I20260807 07:00:16.870198 6366 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 07:00:16.873387 6387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:16.874523 6366 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 07:00:16.874703 6366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "59a8be542a664051aef9f242883afc53"
format_stamp: "Formatted at 2026-08-07 07:00:16 on dist-test-slave-tfpf"
server_key: "9dcb95e6d416c92c20cd7c91f133310d"
server_key_iv: "7a7ab661f822257bb5b1f90e27bdb90b"
server_key_version: "encryptionkey@0"
I20260807 07:00:16.874917 6366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:16.900878 6366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:16.905025 6366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:16.905403 6366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:16.922302 6366 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:41695
I20260807 07:00:16.922320 6460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:41695 every 8 connection(s)
I20260807 07:00:16.923637 6366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:16.927299 6462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:16.929028 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 6366
I20260807 07:00:16.929237 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:16.929682 11006 external_mini_cluster.cc:1428] Setting key b7e1bfccfe3ce3060ae756bbdb191b27
I20260807 07:00:16.939146 6462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53: Bootstrap starting.
I20260807 07:00:16.942864 6462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:16.944114 6462 log.cc:824] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53: Log is configured to *not* fsync() on all Append() calls
Aug 07 07:00:16 dist-test-slave-tfpf krb5kdc[6344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:16.947137 6462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53: No bootstrap required, opened a new log
I20260807 07:00:16.953051 6467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:16.931547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48250 (local address 127.10.191.190:41695)
0807 07:00:16.932451 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:16.932461 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:16.932502 (+ 41us) server_negotiation.cc:407] Connection header received
0807 07:00:16.934097 (+ 1595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:16.934117 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:16.934466 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:16.934747 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:16.936655 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:16.938059 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:16.939896 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:16.940533 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:16.940669 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:16.945890 (+ 5221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:16.945898 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:16.945910 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:16.945942 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:16.949056 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:16.949810 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:16.949831 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:16.949836 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:16.950023 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:16.950444 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:16.950455 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:16.950461 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:16.950941 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:16.951267 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:16.951732 (+ 465us) server_negotiation.cc:299] Negotiation successful
0807 07:00:16.952133 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":406,"threads_started":1}
I20260807 07:00:16.955147 6462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a8be542a664051aef9f242883afc53" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41695 } }
I20260807 07:00:16.955547 6462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:16.955678 6462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59a8be542a664051aef9f242883afc53, State: Initialized, Role: FOLLOWER
I20260807 07:00:16.956290 6462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a8be542a664051aef9f242883afc53" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41695 } }
I20260807 07:00:16.956533 6462 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:16.956693 6462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:16.956903 6462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:16.958981 6462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a8be542a664051aef9f242883afc53" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41695 } }
I20260807 07:00:16.959455 6462 leader_election.cc:302] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59a8be542a664051aef9f242883afc53; no voters:
I20260807 07:00:16.960012 6462 leader_election.cc:288] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:16.960126 6470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:16.960814 6470 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [term 1 LEADER]: Becoming Leader. State: Replica: 59a8be542a664051aef9f242883afc53, State: Running, Role: LEADER
I20260807 07:00:16.961378 6470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a8be542a664051aef9f242883afc53" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41695 } }
I20260807 07:00:16.962030 6462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:16.964330 6472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59a8be542a664051aef9f242883afc53. Latest consensus state: current_term: 1 leader_uuid: "59a8be542a664051aef9f242883afc53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a8be542a664051aef9f242883afc53" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41695 } } }
I20260807 07:00:16.964260 6471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59a8be542a664051aef9f242883afc53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a8be542a664051aef9f242883afc53" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41695 } } }
I20260807 07:00:16.964710 6471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:16.964721 6472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:16.975682 6475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:16.981426 6475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:16.990252 6475 catalog_manager.cc:1347] Generated new cluster ID: a073fa5340cf46b1a200581dac9a58bc
I20260807 07:00:16.990356 6475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:17.018587 6475 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:17.019882 6475 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:17.029670 6475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53: Generated new TSK 0
I20260807 07:00:17.030416 6475 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.191.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
Entry for principal kudu/127.10.191.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab.
I20260807 07:00:17.110365 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:41695
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:17.449198 6493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:17.449450 6493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:17.449651 6493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:17.456313 6493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:17.456418 6493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:17.456647 6493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 07:00:17.466252 6493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.129.keytab
--principal=kudu/127.10.191.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:41695
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:17.467525 6493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:17.468868 6493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:17.481868 6499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:17.481827 6500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:17.481907 6502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:17.482874 6493 server_base.cc:1034] running on GCE node
I20260807 07:00:17.483469 6493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:17.484252 6493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:17.485455 6493 hybrid_clock.cc:648] HybridClock initialized: now 1786086017485414 us; error 29 us; skew 500 ppm
I20260807 07:00:17.485750 6493 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:17 dist-test-slave-tfpf krb5kdc[6344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086017, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:17.488762 6493 init.cc:377] Logged in from keytab as kudu/127.10.191.129@KRBTEST.COM (short username kudu)
I20260807 07:00:17.490061 6493 webserver.cc:460] Webserver started at http://127.10.191.129:41969/ using document root <none> and password file <none>
I20260807 07:00:17.490669 6493 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:17.490759 6493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:17.491019 6493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:17.493732 6493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "b233f1d776ef486f82d8a3e456002f0d"
format_stamp: "Formatted at 2026-08-07 07:00:17 on dist-test-slave-tfpf"
server_key: "09f36476d40557c2f72d5349a1d28775"
server_key_iv: "4ad3bed7608af035f38bf2c7663b6fd6"
server_key_version: "encryptionkey@0"
I20260807 07:00:17.494469 6493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "b233f1d776ef486f82d8a3e456002f0d"
format_stamp: "Formatted at 2026-08-07 07:00:17 on dist-test-slave-tfpf"
server_key: "09f36476d40557c2f72d5349a1d28775"
server_key_iv: "4ad3bed7608af035f38bf2c7663b6fd6"
server_key_version: "encryptionkey@0"
I20260807 07:00:17.499598 6493 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 07:00:17.503142 6512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:17.504428 6493 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 07:00:17.504608 6493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "b233f1d776ef486f82d8a3e456002f0d"
format_stamp: "Formatted at 2026-08-07 07:00:17 on dist-test-slave-tfpf"
server_key: "09f36476d40557c2f72d5349a1d28775"
server_key_iv: "4ad3bed7608af035f38bf2c7663b6fd6"
server_key_version: "encryptionkey@0"
I20260807 07:00:17.504812 6493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:17.530649 6493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:17.534469 6493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:17.534754 6493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:17.535665 6493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:17.536999 6493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:17.537119 6493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 07:00:17.537293 6493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:17.537358 6493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:17.570245 6493 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:33819
I20260807 07:00:17.570288 6681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:33819 every 8 connection(s)
I20260807 07:00:17.571563 6493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 07:00:17.579542 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 6493
I20260807 07:00:17.579764 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 07:00:17.580227 11006 external_mini_cluster.cc:1428] Setting key 23d94e5cfe2f7de8dd0779638bf8ad5f
Aug 07 07:00:17 dist-test-slave-tfpf krb5kdc[6344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086017, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.129@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:17.591964 6684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:17.574035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:38883 (local address 127.10.191.190:41695)
0807 07:00:17.574488 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:17.574492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:17.575307 (+ 815us) server_negotiation.cc:407] Connection header received
0807 07:00:17.577409 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:17.577414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:17.577509 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:17.577634 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:17.579255 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:17.580125 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:17.581915 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:17.582367 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:17.582463 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:17.586362 (+ 3899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:17.586367 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:17.586370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:17.586403 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:17.588998 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:17.589740 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:17.589745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:17.589750 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:17.589870 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:17.590276 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:17.590281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:17.590284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:17.590567 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:17.590729 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:17.591388 (+ 659us) server_negotiation.cc:299] Negotiation successful
0807 07:00:17.591612 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":237,"threads_started":1}
I20260807 07:00:17.592796 6685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:17.574426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:41695 (local address 127.10.191.129:38883)
0807 07:00:17.575127 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:17.575194 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:17.577049 (+ 1855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:17.577881 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:17.577889 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:17.578509 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:17.579074 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:17.579092 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:17.580353 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:17.580358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:17.581753 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:17.581772 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:17.582590 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:17.582597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:17.582898 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:17.583594 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:00:17.583626 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:17.586154 (+ 2528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:17.589206 (+ 3052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:17.589215 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:17.589228 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:17.589618 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:17.589979 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:17.589984 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:17.589987 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:17.590160 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:17.590700 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:17.590707 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:17.591011 (+ 304us) client_negotiation.cc:769] Sending connection context
0807 07:00:17.591259 (+ 248us) client_negotiation.cc:240] Negotiation successful
0807 07:00:17.591739 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":273,"threads_started":1}
I20260807 07:00:17.594389 6682 heartbeater.cc:347] Connected to a master server at 127.10.191.190:41695
I20260807 07:00:17.594688 6682 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:17.595345 6682 heartbeater.cc:511] Master 127.10.191.190:41695 requested a full tablet report, sending...
I20260807 07:00:17.597671 6414 ts_manager.cc:194] Registered new tserver with Master: b233f1d776ef486f82d8a3e456002f0d (127.10.191.129:33819)
I20260807 07:00:17.599097 6414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.129@KRBTEST.COM'} at 127.10.191.129:38883
WARNING: no policy specified for kudu/127.10.191.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
Entry for principal kudu/127.10.191.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab.
I20260807 07:00:17.650141 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:41695
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:17.981738 6690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:17.982052 6690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:17.982224 6690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:17.988976 6690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:17.989184 6690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:17.989370 6690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 07:00:17.998762 6690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.130.keytab
--principal=kudu/127.10.191.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:41695
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:18.000013 6690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:18.001302 6690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:18.013939 6697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:18.014002 6700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:18.013902 6698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:18.015185 6690 server_base.cc:1034] running on GCE node
I20260807 07:00:18.015836 6690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:18.016784 6690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:18.018008 6690 hybrid_clock.cc:648] HybridClock initialized: now 1786086018017970 us; error 58 us; skew 500 ppm
I20260807 07:00:18.018327 6690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:18 dist-test-slave-tfpf krb5kdc[6344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086018, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:18.021377 6690 init.cc:377] Logged in from keytab as kudu/127.10.191.130@KRBTEST.COM (short username kudu)
I20260807 07:00:18.022729 6690 webserver.cc:460] Webserver started at http://127.10.191.130:41893/ using document root <none> and password file <none>
I20260807 07:00:18.023397 6690 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:18.023548 6690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:18.023907 6690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:18.026799 6690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "bdda83439b154d8892a0f0c1bb9fc899"
format_stamp: "Formatted at 2026-08-07 07:00:18 on dist-test-slave-tfpf"
server_key: "abe619239a7559b65d3b13205bf45fa1"
server_key_iv: "a9f4c93a0e1e52515fcbe3157ce6b395"
server_key_version: "encryptionkey@0"
I20260807 07:00:18.027593 6690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "bdda83439b154d8892a0f0c1bb9fc899"
format_stamp: "Formatted at 2026-08-07 07:00:18 on dist-test-slave-tfpf"
server_key: "abe619239a7559b65d3b13205bf45fa1"
server_key_iv: "a9f4c93a0e1e52515fcbe3157ce6b395"
server_key_version: "encryptionkey@0"
I20260807 07:00:18.032645 6690 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 07:00:18.035995 6712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:18.037391 6690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 07:00:18.037575 6690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "bdda83439b154d8892a0f0c1bb9fc899"
format_stamp: "Formatted at 2026-08-07 07:00:18 on dist-test-slave-tfpf"
server_key: "abe619239a7559b65d3b13205bf45fa1"
server_key_iv: "a9f4c93a0e1e52515fcbe3157ce6b395"
server_key_version: "encryptionkey@0"
I20260807 07:00:18.037777 6690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:18.049722 6690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:18.053184 6690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:18.053442 6690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:18.054301 6690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:18.055634 6690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:18.055745 6690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:18.055887 6690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:18.055956 6690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:18.089159 6690 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:37461
I20260807 07:00:18.089208 6869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:37461 every 8 connection(s)
I20260807 07:00:18.090411 6690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 07:00:18.096235 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 6690
I20260807 07:00:18.096426 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 07:00:18.096879 11006 external_mini_cluster.cc:1428] Setting key 81cc3309b05f739c7711390a71de758b
Aug 07 07:00:18 dist-test-slave-tfpf krb5kdc[6344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086018, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.130@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:18.112097 6872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.092813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:58299 (local address 127.10.191.190:41695)
0807 07:00:18.093296 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:18.093303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:18.094117 (+ 814us) server_negotiation.cc:407] Connection header received
0807 07:00:18.095949 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:18.095956 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:18.096056 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:18.096198 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:18.097852 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.098961 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.101196 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.101597 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.101691 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.105837 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:18.105842 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:18.105845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:18.105876 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:18.108666 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:18.109526 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:18.109531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:18.109534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:18.109683 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:18.110127 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:18.110132 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:18.110141 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:18.110412 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:18.110592 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:18.111335 (+ 743us) server_negotiation.cc:299] Negotiation successful
0807 07:00:18.111587 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":219,"threads_started":1}
I20260807 07:00:18.113024 6873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.093354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:41695 (local address 127.10.191.130:58299)
0807 07:00:18.093976 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:18.094011 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:18.095647 (+ 1636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:18.096434 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:18.096442 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:18.097035 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:18.097660 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.097685 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.099129 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.099134 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.101039 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.101056 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.101813 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.101822 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.102143 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.102856 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:00:18.102887 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:18.105592 (+ 2705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:18.108811 (+ 3219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:18.108820 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:18.108834 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:18.109402 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:18.109798 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:18.109803 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:18.109806 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:18.109999 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:18.110565 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:18.110572 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:18.110904 (+ 332us) client_negotiation.cc:769] Sending connection context
0807 07:00:18.111181 (+ 277us) client_negotiation.cc:240] Negotiation successful
0807 07:00:18.111687 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":234,"threads_started":1}
I20260807 07:00:18.114702 6870 heartbeater.cc:347] Connected to a master server at 127.10.191.190:41695
I20260807 07:00:18.114989 6870 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:18.115800 6870 heartbeater.cc:511] Master 127.10.191.190:41695 requested a full tablet report, sending...
I20260807 07:00:18.117406 6414 ts_manager.cc:194] Registered new tserver with Master: bdda83439b154d8892a0f0c1bb9fc899 (127.10.191.130:37461)
I20260807 07:00:18.118199 6414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.130@KRBTEST.COM'} at 127.10.191.130:58299
WARNING: no policy specified for kudu/127.10.191.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
Entry for principal kudu/127.10.191.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab.
I20260807 07:00:18.163970 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:41695
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:18.501281 6877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:18.501549 6877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:18.501695 6877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:18.508495 6877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:18.508653 6877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:18.508826 6877 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 07:00:18.518685 6877 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.131.keytab
--principal=kudu/127.10.191.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:41695
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:18.519992 6877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:18.521320 6877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:18.534519 6885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:18.534857 6882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:18.534852 6888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:18.535573 6877 server_base.cc:1034] running on GCE node
I20260807 07:00:18.536204 6877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:18.537248 6877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:18.538509 6877 hybrid_clock.cc:648] HybridClock initialized: now 1786086018538434 us; error 46 us; skew 500 ppm
I20260807 07:00:18.538833 6877 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:18 dist-test-slave-tfpf krb5kdc[6344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086018, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:18.542328 6877 init.cc:377] Logged in from keytab as kudu/127.10.191.131@KRBTEST.COM (short username kudu)
I20260807 07:00:18.543613 6877 webserver.cc:460] Webserver started at http://127.10.191.131:33347/ using document root <none> and password file <none>
I20260807 07:00:18.544272 6877 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:18.544418 6877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:18.544796 6877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:18.547662 6877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "92a60ef790554384b2eb66b62c0095a6"
format_stamp: "Formatted at 2026-08-07 07:00:18 on dist-test-slave-tfpf"
server_key: "d8cae67ad6f95a95061b0766f9413195"
server_key_iv: "b53fb7e44e6ad518fa3ec2cbaa2bece9"
server_key_version: "encryptionkey@0"
I20260807 07:00:18.548364 6877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "92a60ef790554384b2eb66b62c0095a6"
format_stamp: "Formatted at 2026-08-07 07:00:18 on dist-test-slave-tfpf"
server_key: "d8cae67ad6f95a95061b0766f9413195"
server_key_iv: "b53fb7e44e6ad518fa3ec2cbaa2bece9"
server_key_version: "encryptionkey@0"
I20260807 07:00:18.553310 6877 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 07:00:18.556457 6897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:18.557788 6877 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 07:00:18.557921 6877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "92a60ef790554384b2eb66b62c0095a6"
format_stamp: "Formatted at 2026-08-07 07:00:18 on dist-test-slave-tfpf"
server_key: "d8cae67ad6f95a95061b0766f9413195"
server_key_iv: "b53fb7e44e6ad518fa3ec2cbaa2bece9"
server_key_version: "encryptionkey@0"
I20260807 07:00:18.558151 6877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:18.570858 6877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:18.574647 6877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:18.574851 6877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:18.575696 6877 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:18.577152 6877 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:18.577227 6877 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:18.577315 6877 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:18.577364 6877 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:18.601927 6682 heartbeater.cc:503] Master 127.10.191.190:41695 was elected leader, sending a full tablet report...
I20260807 07:00:18.611639 6877 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:39665
I20260807 07:00:18.611675 7053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:39665 every 8 connection(s)
I20260807 07:00:18.612918 6877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 07:00:18.620772 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 6877
I20260807 07:00:18.620966 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 07:00:18.621487 11006 external_mini_cluster.cc:1428] Setting key f2e0cc50fcd370bf2c312d4cd36b1bbf
Aug 07 07:00:18 dist-test-slave-tfpf krb5kdc[6344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086018, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.131@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:18.636205 7058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.615403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:53189 (local address 127.10.191.190:41695)
0807 07:00:18.615865 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:18.615870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:18.616790 (+ 920us) server_negotiation.cc:407] Connection header received
0807 07:00:18.618556 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:18.618560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:18.618635 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:18.618728 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:18.620130 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.620930 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.622670 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.623085 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.623221 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.630940 (+ 7719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:18.630945 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:18.630949 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:18.630981 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:18.633369 (+ 2388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:18.634029 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:18.634034 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:18.634037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:18.634172 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:18.634585 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:18.634589 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:18.634591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:18.634849 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:18.635012 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:18.635619 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 07:00:18.635850 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":217,"threads_started":1}
I20260807 07:00:18.637167 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.615957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:41695 (local address 127.10.191.131:53189)
0807 07:00:18.616586 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:18.616628 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:18.618308 (+ 1680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:18.618947 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:18.618954 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:18.619454 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:18.619985 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.620001 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.621134 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.621138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.622521 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.622533 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.623300 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.623308 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.623603 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.628643 (+ 5040us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:00:18.628664 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:18.630745 (+ 2081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:18.633524 (+ 2779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:18.633532 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:18.633550 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:18.633905 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:18.634303 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:00:18.634308 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:00:18.634311 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:00:18.634472 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:00:18.634984 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:18.634991 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:18.635276 (+ 285us) client_negotiation.cc:769] Sending connection context
0807 07:00:18.635513 (+ 237us) client_negotiation.cc:240] Negotiation successful
0807 07:00:18.635986 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":234,"threads_started":1}
I20260807 07:00:18.638451 7056 heartbeater.cc:347] Connected to a master server at 127.10.191.190:41695
I20260807 07:00:18.638748 7056 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:18.639451 7056 heartbeater.cc:511] Master 127.10.191.190:41695 requested a full tablet report, sending...
I20260807 07:00:18.640771 6414 ts_manager.cc:194] Registered new tserver with Master: 92a60ef790554384b2eb66b62c0095a6 (127.10.191.131:39665)
I20260807 07:00:18.641597 6414 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.191.131@KRBTEST.COM'} at 127.10.191.131:53189
I20260807 07:00:18.648430 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 07:00:18.663597 7058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.652212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48266 (local address 127.10.191.190:41695)
0807 07:00:18.652406 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:18.652415 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:18.652815 (+ 400us) server_negotiation.cc:407] Connection header received
0807 07:00:18.652931 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:18.652934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:18.653020 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:18.653174 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:18.654487 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.655081 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.656240 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.656614 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.656727 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.658976 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:18.658980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:18.658982 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:18.659006 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:18.661208 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:18.661782 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:18.661785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:18.661787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:18.661883 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:18.662227 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:18.662230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:18.662232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:18.662626 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:18.662854 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:18.663130 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 07:00:18.663284 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 07:00:18.667196 6414 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48266:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:00:18.673717 6414 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:00:18.707448 7077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.685693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35310 (local address 127.10.191.131:39665)
0807 07:00:18.699044 (+ 13351us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:18.699055 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:18.699097 (+ 42us) server_negotiation.cc:407] Connection header received
0807 07:00:18.699218 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:18.699229 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:18.699528 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:18.699777 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:18.701610 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.702991 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.704978 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.706304 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.706497 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.706662 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:18.706933 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 07:00:18.707070 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13112,"thread_start_us":12909,"threads_started":1}
I20260807 07:00:18.707530 7076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.685435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39665 (local address 127.0.0.1:35310)
0807 07:00:18.696953 (+ 11518us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:18.697003 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:18.697251 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:18.700154 (+ 2903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:18.700178 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:18.700215 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:18.700748 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.700760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.703118 (+ 2358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.703124 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.704811 (+ 1687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.704828 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.706501 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.706506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.706719 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.706767 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 07:00:18.706896 (+ 129us) client_negotiation.cc:240] Negotiation successful
0807 07:00:18.707068 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11185,"mutex_wait_us":66,"thread_start_us":13622,"threads_started":1}
I20260807 07:00:18.708254 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.686077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.10.191.130:37461)
0807 07:00:18.698286 (+ 12209us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:18.698297 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:18.699615 (+ 1318us) server_negotiation.cc:407] Connection header received
0807 07:00:18.699725 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:18.699732 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:18.699961 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:18.700148 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:18.701580 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.703093 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.705530 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.706835 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.706971 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.707110 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:18.707715 (+ 605us) server_negotiation.cc:299] Negotiation successful
0807 07:00:18.707886 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12037,"thread_start_us":12213,"threads_started":1}
I20260807 07:00:18.709101 7075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.685622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:37461 (local address 127.0.0.1:48218)
0807 07:00:18.699325 (+ 13703us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:18.699343 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:18.699479 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:18.700475 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:18.700482 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:18.700516 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:18.701416 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.701431 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.703251 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.703257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.705218 (+ 1961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.705232 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.707285 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.707291 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.707495 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.707532 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 07:00:18.708567 (+ 1035us) client_negotiation.cc:240] Negotiation successful
0807 07:00:18.708686 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13574,"mutex_wait_us":446,"thread_start_us":11845,"threads_started":1}
I20260807 07:00:18.709758 7081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.700071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:33819 (local address 127.0.0.1:34836)
0807 07:00:18.701410 (+ 1339us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:18.701426 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:18.701548 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:18.702297 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:18.702301 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:18.702324 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:18.702683 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.702693 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.704451 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.704456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.706569 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.706585 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.708873 (+ 2288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.708880 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.709053 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.709119 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 07:00:18.709212 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 07:00:18.709389 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1205,"mutex_wait_us":2,"thread_start_us":1016,"threads_started":1}
I20260807 07:00:18.710512 7080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.698655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34836 (local address 127.10.191.129:33819)
0807 07:00:18.701113 (+ 2458us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:18.701120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:18.701544 (+ 424us) server_negotiation.cc:407] Connection header received
0807 07:00:18.701693 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:18.701699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:18.701908 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:18.702083 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:18.702854 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.704307 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.706764 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.708290 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.708504 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.708686 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:18.709963 (+ 1277us) server_negotiation.cc:299] Negotiation successful
0807 07:00:18.710120 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2242,"thread_start_us":2051,"threads_started":1}
I20260807 07:00:18.712028 6971 tablet_service.cc:1467] Processing CreateTablet for tablet 133ed71582d04057a9c8585682d77090 (DEFAULT_TABLE table=test-table [id=447aef0e9a7e48f8a157297c4566a161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:18.712649 6784 tablet_service.cc:1467] Processing CreateTablet for tablet 133ed71582d04057a9c8585682d77090 (DEFAULT_TABLE table=test-table [id=447aef0e9a7e48f8a157297c4566a161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:18.713558 6971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133ed71582d04057a9c8585682d77090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:18.713428 6588 tablet_service.cc:1467] Processing CreateTablet for tablet 133ed71582d04057a9c8585682d77090 (DEFAULT_TABLE table=test-table [id=447aef0e9a7e48f8a157297c4566a161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:18.713948 6784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133ed71582d04057a9c8585682d77090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:18.714692 6588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133ed71582d04057a9c8585682d77090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:18.725477 7082 tablet_bootstrap.cc:492] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: Bootstrap starting.
I20260807 07:00:18.727830 7084 tablet_bootstrap.cc:492] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: Bootstrap starting.
I20260807 07:00:18.728611 7083 tablet_bootstrap.cc:492] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: Bootstrap starting.
I20260807 07:00:18.729235 7082 tablet_bootstrap.cc:654] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:18.732287 7084 tablet_bootstrap.cc:654] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:18.732517 7083 tablet_bootstrap.cc:654] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:18.733143 7082 log.cc:824] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:18.733551 7084 log.cc:824] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:18.733858 7083 log.cc:824] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:18.736241 7084 tablet_bootstrap.cc:492] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: No bootstrap required, opened a new log
I20260807 07:00:18.736491 7084 ts_tablet_manager.cc:1397] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 07:00:18.736507 7082 tablet_bootstrap.cc:492] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: No bootstrap required, opened a new log
I20260807 07:00:18.736799 7082 ts_tablet_manager.cc:1397] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.005s
I20260807 07:00:18.736847 7083 tablet_bootstrap.cc:492] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: No bootstrap required, opened a new log
I20260807 07:00:18.737118 7083 ts_tablet_manager.cc:1397] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 07:00:18.744144 7084 raft_consensus.cc:348] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } }
I20260807 07:00:18.744505 7084 raft_consensus.cc:374] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:18.744634 7084 raft_consensus.cc:729] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a60ef790554384b2eb66b62c0095a6, State: Initialized, Role: FOLLOWER
I20260807 07:00:18.745352 7084 consensus_queue.cc:260] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } }
I20260807 07:00:18.746403 7056 heartbeater.cc:503] Master 127.10.191.190:41695 was elected leader, sending a full tablet report...
I20260807 07:00:18.747289 7082 raft_consensus.cc:348] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } }
I20260807 07:00:18.747289 7083 raft_consensus.cc:348] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } }
I20260807 07:00:18.747728 7083 raft_consensus.cc:374] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:18.747795 7082 raft_consensus.cc:374] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:18.747839 7083 raft_consensus.cc:729] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdda83439b154d8892a0f0c1bb9fc899, State: Initialized, Role: FOLLOWER
I20260807 07:00:18.747895 7082 raft_consensus.cc:729] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b233f1d776ef486f82d8a3e456002f0d, State: Initialized, Role: FOLLOWER
I20260807 07:00:18.748322 7084 ts_tablet_manager.cc:1428] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260807 07:00:18.748428 7083 consensus_queue.cc:260] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } }
I20260807 07:00:18.748453 7082 consensus_queue.cc:260] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } }
I20260807 07:00:18.750200 7082 ts_tablet_manager.cc:1428] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: Time spent starting tablet: real 0.013s user 0.009s sys 0.006s
I20260807 07:00:18.750532 7083 ts_tablet_manager.cc:1428] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: Time spent starting tablet: real 0.013s user 0.011s sys 0.002s
I20260807 07:00:18.750939 6870 heartbeater.cc:503] Master 127.10.191.190:41695 was elected leader, sending a full tablet report...
W20260807 07:00:18.823982 6683 tablet.cc:2369] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 07:00:18.842339 6871 tablet.cc:2369] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 07:00:18.864535 7057 tablet.cc:2369] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:00:18.921458 7089 raft_consensus.cc:482] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:00:18.921820 7089 raft_consensus.cc:504] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } }
I20260807 07:00:18.923592 7089 leader_election.cc:288] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92a60ef790554384b2eb66b62c0095a6 (127.10.191.131:39665), bdda83439b154d8892a0f0c1bb9fc899 (127.10.191.130:37461)
I20260807 07:00:18.931690 7077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.924677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:51511 (local address 127.10.191.131:39665)
0807 07:00:18.924850 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:18.924858 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:18.925686 (+ 828us) server_negotiation.cc:407] Connection header received
0807 07:00:18.925882 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:18.925889 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:18.925963 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:18.926082 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:18.926684 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.927698 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.929609 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.930736 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.930898 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.930983 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:18.931316 (+ 333us) server_negotiation.cc:299] Negotiation successful
0807 07:00:18.931445 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 07:00:18.931728 7093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.923972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:39665 (local address 127.10.191.129:51511)
0807 07:00:18.925558 (+ 1586us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:18.925575 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:18.925701 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:18.926110 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:18.926117 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:18.926150 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:18.926501 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.926511 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.927855 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.927859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.929453 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.929465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.930948 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.930954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.931140 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.931174 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 07:00:18.931273 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 07:00:18.931396 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1475,"thread_start_us":910,"threads_started":1}
I20260807 07:00:18.931924 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.924197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:45343 (local address 127.10.191.130:37461)
0807 07:00:18.924453 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:18.924460 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:18.924953 (+ 493us) server_negotiation.cc:407] Connection header received
0807 07:00:18.925326 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:18.925333 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:18.925412 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:18.925482 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:18.926280 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.927290 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.929773 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.930907 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.931046 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.931141 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:18.931544 (+ 403us) server_negotiation.cc:299] Negotiation successful
0807 07:00:18.931679 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260807 07:00:18.932575 7094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:18.923931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:37461 (local address 127.10.191.129:45343)
0807 07:00:18.924812 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:18.924854 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:18.925131 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:18.925682 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:18.925685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:18.925714 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:18.926141 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.926156 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.927463 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.927468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.929618 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:18.929632 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:18.931156 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:18.931165 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:18.931357 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:18.931390 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 07:00:18.932123 (+ 733us) client_negotiation.cc:240] Negotiation successful
0807 07:00:18.932255 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"mutex_wait_us":1,"thread_start_us":1318,"threads_started":1}
I20260807 07:00:18.932729 6994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133ed71582d04057a9c8585682d77090" candidate_uuid: "b233f1d776ef486f82d8a3e456002f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a60ef790554384b2eb66b62c0095a6" is_pre_election: true
I20260807 07:00:18.933362 6994 raft_consensus.cc:2454] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b233f1d776ef486f82d8a3e456002f0d in term 0.
I20260807 07:00:18.933744 6814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133ed71582d04057a9c8585682d77090" candidate_uuid: "b233f1d776ef486f82d8a3e456002f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdda83439b154d8892a0f0c1bb9fc899" is_pre_election: true
I20260807 07:00:18.934078 6514 leader_election.cc:302] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92a60ef790554384b2eb66b62c0095a6, b233f1d776ef486f82d8a3e456002f0d; no voters:
I20260807 07:00:18.934275 6814 raft_consensus.cc:2454] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b233f1d776ef486f82d8a3e456002f0d in term 0.
I20260807 07:00:18.934530 7089 raft_consensus.cc:2781] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:00:18.934660 7089 raft_consensus.cc:482] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:00:18.934748 7089 raft_consensus.cc:3037] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:18.937937 7089 raft_consensus.cc:504] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } }
I20260807 07:00:18.938592 7089 leader_election.cc:288] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [CANDIDATE]: Term 1 election: Requested vote from peers 92a60ef790554384b2eb66b62c0095a6 (127.10.191.131:39665), bdda83439b154d8892a0f0c1bb9fc899 (127.10.191.130:37461)
I20260807 07:00:18.939025 6994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133ed71582d04057a9c8585682d77090" candidate_uuid: "b233f1d776ef486f82d8a3e456002f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92a60ef790554384b2eb66b62c0095a6"
I20260807 07:00:18.939069 6814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133ed71582d04057a9c8585682d77090" candidate_uuid: "b233f1d776ef486f82d8a3e456002f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdda83439b154d8892a0f0c1bb9fc899"
I20260807 07:00:18.939208 6994 raft_consensus.cc:3037] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:18.939256 6814 raft_consensus.cc:3037] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:18.941586 6814 raft_consensus.cc:2454] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b233f1d776ef486f82d8a3e456002f0d in term 1.
I20260807 07:00:18.941972 6515 leader_election.cc:302] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b233f1d776ef486f82d8a3e456002f0d, bdda83439b154d8892a0f0c1bb9fc899; no voters:
I20260807 07:00:18.942063 6994 raft_consensus.cc:2454] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b233f1d776ef486f82d8a3e456002f0d in term 1.
I20260807 07:00:18.942281 7089 raft_consensus.cc:2781] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:18.942816 7089 raft_consensus.cc:686] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 1 LEADER]: Becoming Leader. State: Replica: b233f1d776ef486f82d8a3e456002f0d, State: Running, Role: LEADER
I20260807 07:00:18.943280 7089 consensus_queue.cc:237] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } }
I20260807 07:00:18.947562 6413 catalog_manager.cc:5495] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d reported cstate change: term changed from 0 to 1, leader changed from <none> to b233f1d776ef486f82d8a3e456002f0d (127.10.191.129). New cstate: current_term: 1 leader_uuid: "b233f1d776ef486f82d8a3e456002f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b233f1d776ef486f82d8a3e456002f0d" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 33819 } health_report { overall_health: HEALTHY } } }
I20260807 07:00:19.004721 7080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:19.000012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34840 (local address 127.10.191.129:33819)
0807 07:00:19.000248 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:19.000253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:19.000272 (+ 19us) server_negotiation.cc:407] Connection header received
0807 07:00:19.000426 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:19.000429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:19.000516 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:19.000647 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:00:19.000992 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:19.001700 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:19.002911 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:19.003259 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:19.003339 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:19.003728 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:00:19.004191 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:00:19.004303 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:19.004367 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 07:00:19.004426 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 07:00:19.012850 6994 raft_consensus.cc:1261] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [term 1 FOLLOWER]: Refusing update from remote peer b233f1d776ef486f82d8a3e456002f0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:19.012866 6814 raft_consensus.cc:1261] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [term 1 FOLLOWER]: Refusing update from remote peer b233f1d776ef486f82d8a3e456002f0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:19.013850 7095 consensus_queue.cc:1035] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdda83439b154d8892a0f0c1bb9fc899" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 37461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:19.014194 7089 consensus_queue.cc:1035] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92a60ef790554384b2eb66b62c0095a6" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:19.024976 7098 mvcc.cc:205] Tried to move back new op lower bound from 7315808333867048960 to 7315808333595443200. Current Snapshot: MvccSnapshot[applied={T|T < 7315808333867048960}]
I20260807 07:00:19.044544 6413 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:19.044833 6413 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48266:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:19.048184 6413 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 59a8be542a664051aef9f242883afc53: Sending DeleteTablet for 3 replicas of tablet 133ed71582d04057a9c8585682d77090
I20260807 07:00:19.049346 6971 tablet_service.cc:1514] Processing DeleteTablet for tablet 133ed71582d04057a9c8585682d77090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:19 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:35310
I20260807 07:00:19.049418 6588 tablet_service.cc:1514] Processing DeleteTablet for tablet 133ed71582d04057a9c8585682d77090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:19 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:34836
I20260807 07:00:19.049441 6784 tablet_service.cc:1514] Processing DeleteTablet for tablet 133ed71582d04057a9c8585682d77090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:19 UTC) from {username='kudu', principal='kudu/127.10.191.190@KRBTEST.COM'} at 127.0.0.1:48218
I20260807 07:00:19.051769 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 6493
I20260807 07:00:19.060154 7115 tablet_replica.cc:330] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: stopping tablet replica
I20260807 07:00:19.060626 7115 raft_consensus.cc:2229] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:19.062525 7115 raft_consensus.cc:2258] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:19.066871 7115 ts_tablet_manager.cc:1905] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:19.066980 7116 tablet_replica.cc:330] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: stopping tablet replica
I20260807 07:00:19.067442 7116 raft_consensus.cc:2229] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:00:19.068130 7116 raft_consensus.cc:2258] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:19.068989 7114 tablet_replica.cc:330] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: stopping tablet replica
I20260807 07:00:19.070452 7116 ts_tablet_manager.cc:1905] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 07:00:19 dist-test-slave-tfpf krb5kdc[6344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.129@KRBTEST.COM
I20260807 07:00:19.072683 7114 raft_consensus.cc:2229] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:19.073189 7114 raft_consensus.cc:2258] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:19.074281 7115 ts_tablet_manager.cc:1918] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:19.074457 7115 log.cc:1196] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/133ed71582d04057a9c8585682d77090
I20260807 07:00:19.075022 7115 ts_tablet_manager.cc:1939] T 133ed71582d04057a9c8585682d77090 P bdda83439b154d8892a0f0c1bb9fc899: Deleting consensus metadata
I20260807 07:00:19.075951 7114 ts_tablet_manager.cc:1905] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:19.076891 6390 catalog_manager.cc:4841] TS bdda83439b154d8892a0f0c1bb9fc899 (127.10.191.130:37461): tablet 133ed71582d04057a9c8585682d77090 (table test-table [id=447aef0e9a7e48f8a157297c4566a161]) successfully deleted
I20260807 07:00:19.082396 7114 ts_tablet_manager.cc:1918] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:19.082530 7114 log.cc:1196] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/133ed71582d04057a9c8585682d77090
I20260807 07:00:19.082995 7116 ts_tablet_manager.cc:1918] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:19.083030 7114 ts_tablet_manager.cc:1939] T 133ed71582d04057a9c8585682d77090 P 92a60ef790554384b2eb66b62c0095a6: Deleting consensus metadata
I20260807 07:00:19.083148 7116 log.cc:1196] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/133ed71582d04057a9c8585682d77090
I20260807 07:00:19.083940 7080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:19.052879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34846 (local address 127.10.191.129:33819)
0807 07:00:19.053039 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:19.053046 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:19.060364 (+ 7318us) server_negotiation.cc:407] Connection header received
0807 07:00:19.060681 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:19.060686 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:19.060770 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:19.060858 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:19.063186 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:19.064674 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:19.066912 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:19.067672 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:19.067777 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:19.076224 (+ 8447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:19.076238 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:19.076253 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:19.076293 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:19.080382 (+ 4089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:19.081273 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:19.081284 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:19.081288 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:19.081461 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:19.081957 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:19.081962 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:19.081966 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:19.082425 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:19.082727 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:19.083370 (+ 643us) server_negotiation.cc:299] Negotiation successful
0807 07:00:19.083622 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 07:00:19.084586 6389 catalog_manager.cc:4841] TS 92a60ef790554384b2eb66b62c0095a6 (127.10.191.131:39665): tablet 133ed71582d04057a9c8585682d77090 (table test-table [id=447aef0e9a7e48f8a157297c4566a161]) successfully deleted
I20260807 07:00:19.084888 7116 ts_tablet_manager.cc:1939] T 133ed71582d04057a9c8585682d77090 P b233f1d776ef486f82d8a3e456002f0d: Deleting consensus metadata
I20260807 07:00:19.085054 6675 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:19.178251 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 6493
I20260807 07:00:19.178349 6390 catalog_manager.cc:4841] TS b233f1d776ef486f82d8a3e456002f0d (127.10.191.129:33819): tablet 133ed71582d04057a9c8585682d77090 (table test-table [id=447aef0e9a7e48f8a157297c4566a161]) successfully deleted
I20260807 07:00:19.203040 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 6690
Aug 07 07:00:19 dist-test-slave-tfpf krb5kdc[6344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.130@KRBTEST.COM
I20260807 07:00:19.217391 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:19.203857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48220 (local address 127.10.191.130:37461)
0807 07:00:19.204028 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:19.204032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:19.204050 (+ 18us) server_negotiation.cc:407] Connection header received
0807 07:00:19.204168 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:19.204172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:19.204233 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:19.204310 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:19.205570 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:19.206252 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:19.207360 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:19.207750 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:19.207838 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:19.212189 (+ 4351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:19.212200 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:19.212214 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:19.212249 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:19.214925 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:19.215554 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:19.215568 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:19.215570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:19.215705 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:19.216030 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:19.216033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:19.216034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:19.216386 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:19.216605 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:19.216865 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 07:00:19.217014 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 07:00:19.218122 6864 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:19.303061 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 6690
I20260807 07:00:19.326651 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 6877
Aug 07 07:00:19 dist-test-slave-tfpf krb5kdc[6344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.131@KRBTEST.COM
I20260807 07:00:19.340632 7077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:19.327358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35318 (local address 127.10.191.131:39665)
0807 07:00:19.327544 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:19.327548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:19.327573 (+ 25us) server_negotiation.cc:407] Connection header received
0807 07:00:19.327701 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:19.327706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:19.327772 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:19.327868 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:19.329166 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:19.329802 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:19.330969 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:19.331340 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:19.331418 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:19.335495 (+ 4077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:19.335510 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:19.335526 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:19.335557 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:19.338388 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:19.339009 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:19.339016 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:19.339018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:19.339164 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:19.339484 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:19.339487 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:19.339489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:19.339819 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:19.340027 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:19.340217 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 07:00:19.340376 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 07:00:19.341328 7048 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:19.425275 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 6877
I20260807 07:00:19.451160 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 6366
I20260807 07:00:19.452263 6454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:19.559262 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 6366
2026-08-07T07:00:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4603 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T07:00:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:19Z Disabled control of system clock
I20260807 07:00:19.661424 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42255
--webserver_interface=127.10.191.190
--webserver_port=0
--builtin_ntp_servers=127.10.191.148:44049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:42255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 07:00:19.996922 7128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:19.997267 7128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:19.997366 7128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:20.004331 7128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:20.004456 7128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:20.004508 7128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:20.004552 7128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:20.004597 7128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:20.013180 7128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:42255
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:20.014307 7128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:20.016076 7128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:20.027549 7138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:20.027657 7137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:20.027613 7141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:20.028281 7128 server_base.cc:1034] running on GCE node
I20260807 07:00:20.029048 7128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:20.030282 7128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:20.031493 7128 hybrid_clock.cc:648] HybridClock initialized: now 1786086020031428 us; error 49 us; skew 500 ppm
I20260807 07:00:20.031854 7128 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:20.034076 7128 webserver.cc:460] Webserver started at http://127.10.191.190:34977/ using document root <none> and password file <none>
I20260807 07:00:20.034754 7128 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:20.034873 7128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:20.035218 7128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:20.038201 7128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "a93d78c1f7ad48dd91e2707e7d2544db"
format_stamp: "Formatted at 2026-08-07 07:00:20 on dist-test-slave-tfpf"
server_key: "bed45dcb4ae101cd335e074e281819cb"
server_key_iv: "7041637cbfa7dc7d4e072043bf005528"
server_key_version: "encryptionkey@0"
I20260807 07:00:20.039011 7128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "a93d78c1f7ad48dd91e2707e7d2544db"
format_stamp: "Formatted at 2026-08-07 07:00:20 on dist-test-slave-tfpf"
server_key: "bed45dcb4ae101cd335e074e281819cb"
server_key_iv: "7041637cbfa7dc7d4e072043bf005528"
server_key_version: "encryptionkey@0"
I20260807 07:00:20.044011 7128 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 07:00:20.047519 7152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:20.048928 7128 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 07:00:20.049129 7128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "a93d78c1f7ad48dd91e2707e7d2544db"
format_stamp: "Formatted at 2026-08-07 07:00:20 on dist-test-slave-tfpf"
server_key: "bed45dcb4ae101cd335e074e281819cb"
server_key_iv: "7041637cbfa7dc7d4e072043bf005528"
server_key_version: "encryptionkey@0"
I20260807 07:00:20.049356 7128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:20.064181 7128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:20.064873 7128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:20.065183 7128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:20.083282 7128 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:42255
I20260807 07:00:20.083310 7226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:42255 every 8 connection(s)
I20260807 07:00:20.084482 7128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:20.088023 7228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:20.088487 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 7128
I20260807 07:00:20.088690 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:20.089213 11006 external_mini_cluster.cc:1428] Setting key 94fe77e160cb2be719742d64023233e1
I20260807 07:00:20.102298 7228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db: Bootstrap starting.
I20260807 07:00:20.104262 7231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:20.091135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.10.191.190:42255)
0807 07:00:20.092193 (+ 1058us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:20.092207 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:20.092258 (+ 51us) server_negotiation.cc:407] Connection header received
0807 07:00:20.094624 (+ 2366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:20.094648 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:20.095194 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:20.095607 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:20.096155 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:20.098017 (+ 1862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:20.099368 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:20.100377 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:20.100533 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:20.101668 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:20.101681 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:20.101697 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:20.102379 (+ 682us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:20.102473 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:20.102497 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:20.102617 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:20.102781 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 07:00:20.103077 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":322,"threads_started":1}
I20260807 07:00:20.105983 7228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:20.107055 7228 log.cc:824] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:20.109766 7228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db: No bootstrap required, opened a new log
I20260807 07:00:20.115867 7228 raft_consensus.cc:348] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93d78c1f7ad48dd91e2707e7d2544db" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42255 } }
I20260807 07:00:20.116194 7228 raft_consensus.cc:374] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:20.116291 7228 raft_consensus.cc:729] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a93d78c1f7ad48dd91e2707e7d2544db, State: Initialized, Role: FOLLOWER
I20260807 07:00:20.116881 7228 consensus_queue.cc:260] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93d78c1f7ad48dd91e2707e7d2544db" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42255 } }
I20260807 07:00:20.117199 7228 raft_consensus.cc:388] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:20.117357 7228 raft_consensus.cc:482] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:20.117537 7228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:20.119534 7228 raft_consensus.cc:504] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93d78c1f7ad48dd91e2707e7d2544db" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42255 } }
I20260807 07:00:20.119993 7228 leader_election.cc:302] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a93d78c1f7ad48dd91e2707e7d2544db; no voters:
I20260807 07:00:20.120543 7228 leader_election.cc:288] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:20.120683 7233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:20.121490 7233 raft_consensus.cc:686] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [term 1 LEADER]: Becoming Leader. State: Replica: a93d78c1f7ad48dd91e2707e7d2544db, State: Running, Role: LEADER
I20260807 07:00:20.122268 7233 consensus_queue.cc:237] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93d78c1f7ad48dd91e2707e7d2544db" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42255 } }
I20260807 07:00:20.122789 7228 sys_catalog.cc:564] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:20.124996 7237 sys_catalog.cc:455] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [sys.catalog]: SysCatalogTable state changed. Reason: New leader a93d78c1f7ad48dd91e2707e7d2544db. Latest consensus state: current_term: 1 leader_uuid: "a93d78c1f7ad48dd91e2707e7d2544db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93d78c1f7ad48dd91e2707e7d2544db" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42255 } } }
I20260807 07:00:20.125144 7234 sys_catalog.cc:455] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a93d78c1f7ad48dd91e2707e7d2544db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93d78c1f7ad48dd91e2707e7d2544db" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42255 } } }
I20260807 07:00:20.125401 7237 sys_catalog.cc:458] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:20.125522 7234 sys_catalog.cc:458] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:20.127038 7245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:20.132272 7245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:20.140348 7245 catalog_manager.cc:1347] Generated new cluster ID: 089b2140c2b44cc2bc1ee51f0c684936
I20260807 07:00:20.140457 7245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:20.147626 7245 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:20.149334 7245 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:20.158582 7245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db: Generated new TSK 0
I20260807 07:00:20.159423 7245 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:20.163533 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.129:0
--local_ip_for_outbound_sockets=127.10.191.129
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42255
--builtin_ntp_servers=127.10.191.148:44049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 07:00:20.501788 7261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:20.502039 7261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:20.502203 7261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:20.509037 7261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:20.509141 7261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:20.509338 7261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.129
I20260807 07:00:20.518270 7261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.191.129
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42255
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.129
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:20.519443 7261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:20.521308 7261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:20.534526 7269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:20.534578 7272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:20.534617 7274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:20.535589 7261 server_base.cc:1034] running on GCE node
I20260807 07:00:20.536190 7261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:20.537179 7261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:20.538408 7261 hybrid_clock.cc:648] HybridClock initialized: now 1786086020538349 us; error 51 us; skew 500 ppm
I20260807 07:00:20.538735 7261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:20.540829 7261 webserver.cc:460] Webserver started at http://127.10.191.129:32915/ using document root <none> and password file <none>
I20260807 07:00:20.541568 7261 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:20.541711 7261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:20.542038 7261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:20.544631 7261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/data/instance:
uuid: "d010902db8d44295b85d069c1397158e"
format_stamp: "Formatted at 2026-08-07 07:00:20 on dist-test-slave-tfpf"
server_key: "0a4b2bd8f3518ebf2826602d7c6cef8e"
server_key_iv: "aeaa3def760be1ad5a428fa38a4e72ff"
server_key_version: "encryptionkey@0"
I20260807 07:00:20.545521 7261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance:
uuid: "d010902db8d44295b85d069c1397158e"
format_stamp: "Formatted at 2026-08-07 07:00:20 on dist-test-slave-tfpf"
server_key: "0a4b2bd8f3518ebf2826602d7c6cef8e"
server_key_iv: "aeaa3def760be1ad5a428fa38a4e72ff"
server_key_version: "encryptionkey@0"
I20260807 07:00:20.550462 7261 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 07:00:20.553807 7284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:20.555055 7261 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 07:00:20.555258 7261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/wal
uuid: "d010902db8d44295b85d069c1397158e"
format_stamp: "Formatted at 2026-08-07 07:00:20 on dist-test-slave-tfpf"
server_key: "0a4b2bd8f3518ebf2826602d7c6cef8e"
server_key_iv: "aeaa3def760be1ad5a428fa38a4e72ff"
server_key_version: "encryptionkey@0"
I20260807 07:00:20.555502 7261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:20.583813 7261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:20.584614 7261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:20.584901 7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:20.585924 7261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:20.587301 7261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:20.587419 7261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:20.587570 7261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:20.587659 7261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:20.621121 7261 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.129:43719
I20260807 07:00:20.621183 7451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.129:43719 every 8 connection(s)
I20260807 07:00:20.622468 7261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/data/info.pb
I20260807 07:00:20.626724 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 7261
I20260807 07:00:20.626889 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/wal/instance
I20260807 07:00:20.627463 11006 external_mini_cluster.cc:1428] Setting key 206101f2d97ba495020c4a075646c5a4
I20260807 07:00:20.630977 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.130:0
--local_ip_for_outbound_sockets=127.10.191.130
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42255
--builtin_ntp_servers=127.10.191.148:44049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 07:00:20.637147 7456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:20.625083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.129:55105 (local address 127.10.191.190:42255)
0807 07:00:20.625496 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:20.625500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:20.626779 (+ 1279us) server_negotiation.cc:407] Connection header received
0807 07:00:20.629204 (+ 2425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:20.629209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:20.629279 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:20.629397 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:20.630899 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:20.631715 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:20.634187 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:20.634541 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:20.634636 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:20.636295 (+ 1659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:20.636300 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:20.636303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:20.636320 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:20.636360 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:20.636371 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:20.636441 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:20.636750 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 07:00:20.636835 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":190,"threads_started":1}
I20260807 07:00:20.638571 7458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:20.625646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42255 (local address 127.10.191.129:55105)
0807 07:00:20.626555 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:20.626628 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:20.628902 (+ 2274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:20.629673 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:20.629684 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:20.629792 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:20.630626 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:20.630655 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:20.631879 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:20.631886 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:20.634032 (+ 2146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:20.634050 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:20.634788 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:20.634815 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:20.635146 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:20.635940 (+ 794us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 07:00:20.635946 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:20.635999 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 07:00:20.636098 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:20.636471 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:20.636484 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:20.636495 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 07:00:20.636733 (+ 238us) client_negotiation.cc:240] Negotiation successful
0807 07:00:20.637176 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":257,"threads_started":1}
I20260807 07:00:20.640100 7454 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42255
I20260807 07:00:20.640448 7454 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:20.641453 7454 heartbeater.cc:511] Master 127.10.191.190:42255 requested a full tablet report, sending...
I20260807 07:00:20.643740 7180 ts_manager.cc:194] Registered new tserver with Master: d010902db8d44295b85d069c1397158e (127.10.191.129:43719)
I20260807 07:00:20.645349 7180 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.129:55105
W20260807 07:00:20.978688 7460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:20.978953 7460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:20.979097 7460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:20.985656 7460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:20.985744 7460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:20.985948 7460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.130
I20260807 07:00:20.994674 7460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.191.130
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42255
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.130
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:20.995820 7460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:20.997745 7460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:21.010660 7473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:21.010782 7468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:21.010628 7469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:21.011376 7460 server_base.cc:1034] running on GCE node
I20260807 07:00:21.011974 7460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:21.012914 7460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:21.014165 7460 hybrid_clock.cc:648] HybridClock initialized: now 1786086021014149 us; error 70 us; skew 500 ppm
I20260807 07:00:21.014472 7460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:21.016726 7460 webserver.cc:460] Webserver started at http://127.10.191.130:38165/ using document root <none> and password file <none>
I20260807 07:00:21.017488 7460 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:21.017637 7460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:21.017962 7460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:21.020732 7460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/data/instance:
uuid: "2c9025466a6045b3b621265b871dc3f5"
format_stamp: "Formatted at 2026-08-07 07:00:21 on dist-test-slave-tfpf"
server_key: "213dee30aefd9cf7d52c2c5df2546903"
server_key_iv: "c9985914c933a4df1de08f88287287b7"
server_key_version: "encryptionkey@0"
I20260807 07:00:21.021564 7460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance:
uuid: "2c9025466a6045b3b621265b871dc3f5"
format_stamp: "Formatted at 2026-08-07 07:00:21 on dist-test-slave-tfpf"
server_key: "213dee30aefd9cf7d52c2c5df2546903"
server_key_iv: "c9985914c933a4df1de08f88287287b7"
server_key_version: "encryptionkey@0"
I20260807 07:00:21.026636 7460 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 07:00:21.029932 7480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:21.031160 7460 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 07:00:21.031342 7460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/wal
uuid: "2c9025466a6045b3b621265b871dc3f5"
format_stamp: "Formatted at 2026-08-07 07:00:21 on dist-test-slave-tfpf"
server_key: "213dee30aefd9cf7d52c2c5df2546903"
server_key_iv: "c9985914c933a4df1de08f88287287b7"
server_key_version: "encryptionkey@0"
I20260807 07:00:21.031533 7460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:21.079227 7460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:21.080039 7460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:21.080344 7460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:21.081358 7460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:21.082888 7460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:21.082993 7460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:21.083096 7460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:21.083163 7460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:21.116194 7460 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.130:44345
I20260807 07:00:21.116287 7649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.130:44345 every 8 connection(s)
I20260807 07:00:21.117601 7460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/data/info.pb
I20260807 07:00:21.118583 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 7460
I20260807 07:00:21.118785 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/wal/instance
I20260807 07:00:21.119228 11006 external_mini_cluster.cc:1428] Setting key 0b17c41a84d7b6ddff060677d87e4329
I20260807 07:00:21.122196 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.191.131:0
--local_ip_for_outbound_sockets=127.10.191.131
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42255
--builtin_ntp_servers=127.10.191.148:44049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 07:00:21.130791 7456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.120345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.130:41535 (local address 127.10.191.190:42255)
0807 07:00:21.120557 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.120571 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.122300 (+ 1729us) server_negotiation.cc:407] Connection header received
0807 07:00:21.124302 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.124309 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.124401 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.124511 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:21.125647 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.126356 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.127976 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.128367 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.128499 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.129968 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:21.129973 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:21.129976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:21.129993 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:21.130024 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:21.130036 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:21.130149 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.130387 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.130481 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 07:00:21.131695 7653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.120937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42255 (local address 127.10.191.130:41535)
0807 07:00:21.122112 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:21.122166 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:21.124027 (+ 1861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:21.124754 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:21.124763 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:21.124844 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:21.125483 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.125499 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.126511 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.126523 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.127794 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.127836 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.128614 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.128625 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.128854 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.129603 (+ 749us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 07:00:21.129606 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:21.129670 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 07:00:21.129767 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:21.130149 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:21.130163 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:21.130173 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 07:00:21.130356 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 07:00:21.130724 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":360,"threads_started":1}
I20260807 07:00:21.133042 7650 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42255
I20260807 07:00:21.133354 7650 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:21.134027 7650 heartbeater.cc:511] Master 127.10.191.190:42255 requested a full tablet report, sending...
I20260807 07:00:21.135458 7180 ts_manager.cc:194] Registered new tserver with Master: 2c9025466a6045b3b621265b871dc3f5 (127.10.191.130:44345)
I20260807 07:00:21.136611 7180 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.130:41535
W20260807 07:00:21.456898 7655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:21.457223 7655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:21.457386 7655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:21.464308 7655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:21.464394 7655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:21.464534 7655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.191.131
I20260807 07:00:21.473352 7655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:44049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.191.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.191.131
--webserver_port=0
--tserver_master_addrs=127.10.191.190:42255
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.191.131
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:21.474619 7655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:21.476393 7655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:21.489033 7662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:21.489082 7668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:21.489141 7663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:21.490252 7655 server_base.cc:1034] running on GCE node
I20260807 07:00:21.490815 7655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:21.491701 7655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:21.492923 7655 hybrid_clock.cc:648] HybridClock initialized: now 1786086021492877 us; error 54 us; skew 500 ppm
I20260807 07:00:21.493264 7655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:00:21.495268 7655 webserver.cc:460] Webserver started at http://127.10.191.131:39627/ using document root <none> and password file <none>
I20260807 07:00:21.496002 7655 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:21.496150 7655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:21.496500 7655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:21.499365 7655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/data/instance:
uuid: "88651fe1408d443681d77fd15131d192"
format_stamp: "Formatted at 2026-08-07 07:00:21 on dist-test-slave-tfpf"
server_key: "611befd36bb136573004c3def979cdd8"
server_key_iv: "41bec10f576919b9ec92ca2d892dfd73"
server_key_version: "encryptionkey@0"
I20260807 07:00:21.500139 7655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance:
uuid: "88651fe1408d443681d77fd15131d192"
format_stamp: "Formatted at 2026-08-07 07:00:21 on dist-test-slave-tfpf"
server_key: "611befd36bb136573004c3def979cdd8"
server_key_iv: "41bec10f576919b9ec92ca2d892dfd73"
server_key_version: "encryptionkey@0"
I20260807 07:00:21.505189 7655 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 07:00:21.508580 7681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:21.509800 7655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 07:00:21.509977 7655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/wal
uuid: "88651fe1408d443681d77fd15131d192"
format_stamp: "Formatted at 2026-08-07 07:00:21 on dist-test-slave-tfpf"
server_key: "611befd36bb136573004c3def979cdd8"
server_key_iv: "41bec10f576919b9ec92ca2d892dfd73"
server_key_version: "encryptionkey@0"
I20260807 07:00:21.510190 7655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:21.522816 7655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:21.523497 7655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:21.523756 7655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:21.524592 7655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 07:00:21.525835 7655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:00:21.525913 7655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:21.525985 7655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 07:00:21.526036 7655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:21.559262 7655 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.131:37589
I20260807 07:00:21.559337 7859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.131:37589 every 8 connection(s)
I20260807 07:00:21.560647 7655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/data/info.pb
I20260807 07:00:21.567076 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 7655
I20260807 07:00:21.567263 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/wal/instance
I20260807 07:00:21.567716 11006 external_mini_cluster.cc:1428] Setting key 4b31c5f9419b1c7d1a2ee9f4d353e7f2
I20260807 07:00:21.572243 7456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.563068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:56331 (local address 127.10.191.190:42255)
0807 07:00:21.563244 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.563249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.564508 (+ 1259us) server_negotiation.cc:407] Connection header received
0807 07:00:21.566144 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.566148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.566210 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.566293 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:21.567255 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.568139 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.569725 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.570131 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.570264 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.571453 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:21.571458 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:21.571461 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:21.571476 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:21.571506 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:21.571518 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:21.571610 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.571832 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.571927 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 07:00:21.573182 7864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.563540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:42255 (local address 127.10.191.131:56331)
0807 07:00:21.564342 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:21.564401 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:21.565914 (+ 1513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:21.566474 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:21.566481 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:21.566552 (+ 71us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:00:21.567073 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.567087 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.568293 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.568304 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.569550 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.569562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.570342 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.570350 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.570572 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.571163 (+ 591us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 07:00:21.571165 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:00:21.571199 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 07:00:21.571264 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:00:21.571611 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:00:21.571623 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:00:21.571633 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 07:00:21.571813 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 07:00:21.572154 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":248,"threads_started":1}
I20260807 07:00:21.574417 7860 heartbeater.cc:347] Connected to a master server at 127.10.191.190:42255
I20260807 07:00:21.574720 7860 heartbeater.cc:464] Registering TS with master...
I20260807 07:00:21.575407 7860 heartbeater.cc:511] Master 127.10.191.190:42255 requested a full tablet report, sending...
I20260807 07:00:21.576740 7180 ts_manager.cc:194] Registered new tserver with Master: 88651fe1408d443681d77fd15131d192 (127.10.191.131:37589)
I20260807 07:00:21.577674 7180 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.191.131:56331
I20260807 07:00:21.582479 11006 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 07:00:21.591651 7456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.586410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50518 (local address 127.10.191.190:42255)
0807 07:00:21.586579 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.586585 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.587028 (+ 443us) server_negotiation.cc:407] Connection header received
0807 07:00:21.587153 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.587157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.587219 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.587292 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:21.587702 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.588320 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.589594 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.589988 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.590075 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.591042 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:21.591046 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:21.591049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:21.591063 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:21.591088 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:21.591098 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:21.591161 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.591280 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.591352 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 07:00:21.595144 7180 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50518:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:00:21.601588 7180 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:00:21.625149 7875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.612754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59074 (local address 127.10.191.129:43719)
0807 07:00:21.614330 (+ 1576us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.614338 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.614365 (+ 27us) server_negotiation.cc:407] Connection header received
0807 07:00:21.614524 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.614531 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.614759 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.614952 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:21.615988 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.617887 (+ 1899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.620967 (+ 3080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.622736 (+ 1769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.624151 (+ 1415us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.624408 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.624479 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.624655 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1436,"thread_start_us":1339,"threads_started":1}
I20260807 07:00:21.625557 7874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.612507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:43719 (local address 127.0.0.1:59074)
0807 07:00:21.613542 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:21.613597 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:21.613785 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:21.615258 (+ 1473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:21.615268 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:21.615303 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:21.615768 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.615784 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.618077 (+ 2293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.618085 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.620714 (+ 2629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.620732 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.623103 (+ 2371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.623110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.623355 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.623419 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 07:00:21.623533 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 07:00:21.623753 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":950,"threads_started":1}
I20260807 07:00:21.630671 7349 tablet_service.cc:1467] Processing CreateTablet for tablet de99d43f9eef4e8c9b6be900702078bb (DEFAULT_TABLE table=test-table [id=f700f25e82d549ef915722072a29856e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:21.632112 7349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de99d43f9eef4e8c9b6be900702078bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:21.636358 7874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.612849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:44345 (local address 127.0.0.1:51252)
0807 07:00:21.626114 (+ 13265us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:21.626133 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:21.626236 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:21.629547 (+ 3311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:21.629551 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:21.629574 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:21.629823 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.629835 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.631663 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.631690 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.633860 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.633875 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.635531 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.635536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.635804 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.635840 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 07:00:21.635927 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 07:00:21.636060 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13130,"mutex_wait_us":97,"thread_start_us":16253,"threads_started":1}
I20260807 07:00:21.636957 7877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.613253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51252 (local address 127.10.191.130:44345)
0807 07:00:21.628465 (+ 15212us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.628474 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.628502 (+ 28us) server_negotiation.cc:407] Connection header received
0807 07:00:21.628608 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.628615 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.628838 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.630013 (+ 1175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:21.630306 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.631509 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.634499 (+ 2990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.635381 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.635548 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.635789 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.636444 (+ 655us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.636604 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15054,"thread_start_us":17116,"threads_started":1}
I20260807 07:00:21.637017 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.614693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49978 (local address 127.10.191.131:37589)
0807 07:00:21.627593 (+ 12900us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.627600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.627658 (+ 58us) server_negotiation.cc:407] Connection header received
0807 07:00:21.627753 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.627762 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.627990 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.629971 (+ 1981us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:21.630223 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.631588 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.634464 (+ 2876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.635710 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.635917 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.636147 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.636208 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.636345 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12725,"thread_start_us":12585,"threads_started":1}
I20260807 07:00:21.637617 7880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.614309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.131:37589 (local address 127.0.0.1:49978)
0807 07:00:21.626867 (+ 12558us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:21.626885 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:21.627035 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:21.629379 (+ 2344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:21.629384 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:21.629407 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:21.629788 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.629798 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.631743 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.631750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.634301 (+ 2551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.634309 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.635916 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.635923 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.636072 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.636100 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 07:00:21.636166 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 07:00:21.636263 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12413,"mutex_wait_us":40,"thread_start_us":12234,"threads_started":1}
I20260807 07:00:21.641145 7554 tablet_service.cc:1467] Processing CreateTablet for tablet de99d43f9eef4e8c9b6be900702078bb (DEFAULT_TABLE table=test-table [id=f700f25e82d549ef915722072a29856e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:21.644204 7762 tablet_service.cc:1467] Processing CreateTablet for tablet de99d43f9eef4e8c9b6be900702078bb (DEFAULT_TABLE table=test-table [id=f700f25e82d549ef915722072a29856e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 07:00:21.645650 7762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de99d43f9eef4e8c9b6be900702078bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:21.645901 7883 tablet_bootstrap.cc:492] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: Bootstrap starting.
I20260807 07:00:21.645964 7554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de99d43f9eef4e8c9b6be900702078bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:21.648397 7454 heartbeater.cc:503] Master 127.10.191.190:42255 was elected leader, sending a full tablet report...
I20260807 07:00:21.649497 7883 tablet_bootstrap.cc:654] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:21.650686 7883 log.cc:824] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:21.655297 7883 tablet_bootstrap.cc:492] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: No bootstrap required, opened a new log
I20260807 07:00:21.655577 7883 ts_tablet_manager.cc:1397] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 07:00:21.659226 7889 tablet_bootstrap.cc:492] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: Bootstrap starting.
I20260807 07:00:21.660696 7893 tablet_bootstrap.cc:492] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: Bootstrap starting.
I20260807 07:00:21.662909 7889 tablet_bootstrap.cc:654] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:21.664141 7893 tablet_bootstrap.cc:654] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:21.664186 7889 log.cc:824] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:21.665347 7893 log.cc:824] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:21.665160 7883 raft_consensus.cc:348] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } }
I20260807 07:00:21.665608 7883 raft_consensus.cc:374] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:21.665716 7883 raft_consensus.cc:729] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d010902db8d44295b85d069c1397158e, State: Initialized, Role: FOLLOWER
I20260807 07:00:21.666389 7883 consensus_queue.cc:260] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } }
I20260807 07:00:21.667446 7889 tablet_bootstrap.cc:492] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: No bootstrap required, opened a new log
I20260807 07:00:21.667794 7889 ts_tablet_manager.cc:1397] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 07:00:21.668270 7883 ts_tablet_manager.cc:1428] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260807 07:00:21.668347 7893 tablet_bootstrap.cc:492] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: No bootstrap required, opened a new log
I20260807 07:00:21.668653 7893 ts_tablet_manager.cc:1397] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.004s
I20260807 07:00:21.675694 7889 raft_consensus.cc:348] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } }
I20260807 07:00:21.676048 7889 raft_consensus.cc:374] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:21.676173 7889 raft_consensus.cc:729] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9025466a6045b3b621265b871dc3f5, State: Initialized, Role: FOLLOWER
I20260807 07:00:21.676091 7893 raft_consensus.cc:348] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } }
I20260807 07:00:21.676563 7893 raft_consensus.cc:374] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:21.676707 7893 raft_consensus.cc:729] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88651fe1408d443681d77fd15131d192, State: Initialized, Role: FOLLOWER
I20260807 07:00:21.676867 7889 consensus_queue.cc:260] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } }
I20260807 07:00:21.677356 7893 consensus_queue.cc:260] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } }
I20260807 07:00:21.677937 7650 heartbeater.cc:503] Master 127.10.191.190:42255 was elected leader, sending a full tablet report...
I20260807 07:00:21.678431 7860 heartbeater.cc:503] Master 127.10.191.190:42255 was elected leader, sending a full tablet report...
I20260807 07:00:21.678574 7889 ts_tablet_manager.cc:1428] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: Time spent starting tablet: real 0.011s user 0.005s sys 0.005s
I20260807 07:00:21.679067 7893 ts_tablet_manager.cc:1428] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260807 07:00:21.790010 7898 raft_consensus.cc:482] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:00:21.790302 7898 raft_consensus.cc:504] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } }
I20260807 07:00:21.792124 7898 leader_election.cc:288] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d010902db8d44295b85d069c1397158e (127.10.191.129:43719), 2c9025466a6045b3b621265b871dc3f5 (127.10.191.130:44345)
I20260807 07:00:21.799108 7864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.792437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.130:44345 (local address 127.10.191.131:40317)
0807 07:00:21.792687 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:21.792715 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:21.792847 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:21.793483 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:21.793487 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:21.793517 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:21.793774 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.793783 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.794923 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.794927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.796994 (+ 2067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.797016 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.798417 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.798422 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.798534 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.798558 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 07:00:21.798631 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 07:00:21.798733 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":49,"spinlock_wait_cycles":15616}
I20260807 07:00:21.799113 7877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.792815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:40317 (local address 127.10.191.130:44345)
0807 07:00:21.793106 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.793113 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.793133 (+ 20us) server_negotiation.cc:407] Connection header received
0807 07:00:21.793214 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.793219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.793303 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.793393 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:21.793917 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.794789 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.797178 (+ 2389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.798275 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.798430 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.798498 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.798706 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.798857 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 07:00:21.799685 7875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.792579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.191.131:53319 (local address 127.10.191.129:43719)
0807 07:00:21.792794 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.792802 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.793523 (+ 721us) server_negotiation.cc:407] Connection header received
0807 07:00:21.793741 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.793745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.793807 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.793911 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 07:00:21.794371 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.795177 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.797527 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.798755 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.798912 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.798975 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.799347 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.799464 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 07:00:21.800129 7588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de99d43f9eef4e8c9b6be900702078bb" candidate_uuid: "88651fe1408d443681d77fd15131d192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9025466a6045b3b621265b871dc3f5" is_pre_election: true
I20260807 07:00:21.800406 7899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.792528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.129:43719 (local address 127.10.191.131:53319)
0807 07:00:21.793397 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 07:00:21.793413 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 07:00:21.793618 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:00:21.793938 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:00:21.793941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:00:21.793960 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 07:00:21.794216 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.794223 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.795313 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.795319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.797341 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:00:21.797353 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.798940 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.798946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:00:21.799113 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.799152 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 07:00:21.799872 (+ 720us) client_negotiation.cc:240] Negotiation successful
0807 07:00:21.800000 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"mutex_wait_us":135,"spinlock_wait_cycles":50432,"thread_start_us":444,"threads_started":1}
I20260807 07:00:21.800738 7588 raft_consensus.cc:2454] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88651fe1408d443681d77fd15131d192 in term 0.
I20260807 07:00:21.801469 7686 leader_election.cc:302] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9025466a6045b3b621265b871dc3f5, 88651fe1408d443681d77fd15131d192; no voters:
I20260807 07:00:21.801550 7381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de99d43f9eef4e8c9b6be900702078bb" candidate_uuid: "88651fe1408d443681d77fd15131d192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d010902db8d44295b85d069c1397158e" is_pre_election: true
I20260807 07:00:21.801928 7898 raft_consensus.cc:2781] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:00:21.802085 7898 raft_consensus.cc:482] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:00:21.802078 7381 raft_consensus.cc:2454] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88651fe1408d443681d77fd15131d192 in term 0.
I20260807 07:00:21.802201 7898 raft_consensus.cc:3037] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:21.804332 7898 raft_consensus.cc:504] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } }
I20260807 07:00:21.804867 7898 leader_election.cc:288] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [CANDIDATE]: Term 1 election: Requested vote from peers d010902db8d44295b85d069c1397158e (127.10.191.129:43719), 2c9025466a6045b3b621265b871dc3f5 (127.10.191.130:44345)
I20260807 07:00:21.805311 7381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de99d43f9eef4e8c9b6be900702078bb" candidate_uuid: "88651fe1408d443681d77fd15131d192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d010902db8d44295b85d069c1397158e"
I20260807 07:00:21.805311 7588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de99d43f9eef4e8c9b6be900702078bb" candidate_uuid: "88651fe1408d443681d77fd15131d192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9025466a6045b3b621265b871dc3f5"
I20260807 07:00:21.805491 7381 raft_consensus.cc:3037] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:21.805505 7588 raft_consensus.cc:3037] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:21.807807 7588 raft_consensus.cc:2454] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88651fe1408d443681d77fd15131d192 in term 1.
I20260807 07:00:21.807865 7381 raft_consensus.cc:2454] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88651fe1408d443681d77fd15131d192 in term 1.
I20260807 07:00:21.808288 7686 leader_election.cc:302] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9025466a6045b3b621265b871dc3f5, 88651fe1408d443681d77fd15131d192; no voters:
I20260807 07:00:21.808576 7898 raft_consensus.cc:2781] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:21.809020 7898 raft_consensus.cc:686] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 1 LEADER]: Becoming Leader. State: Replica: 88651fe1408d443681d77fd15131d192, State: Running, Role: LEADER
I20260807 07:00:21.809610 7898 consensus_queue.cc:237] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } }
W20260807 07:00:21.812340 7862 tablet.cc:2369] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:00:21.813946 7180 catalog_manager.cc:5495] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88651fe1408d443681d77fd15131d192 (127.10.191.131). New cstate: current_term: 1 leader_uuid: "88651fe1408d443681d77fd15131d192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88651fe1408d443681d77fd15131d192" member_type: VOTER last_known_addr { host: "127.10.191.131" port: 37589 } health_report { overall_health: HEALTHY } } }
I20260807 07:00:21.830936 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.825691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49986 (local address 127.10.191.131:37589)
0807 07:00:21.825883 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.825890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.826105 (+ 215us) server_negotiation.cc:407] Connection header received
0807 07:00:21.826244 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.826248 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.826323 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.826439 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:00:21.826762 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.827540 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.829023 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.829471 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.829562 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.829974 (+ 412us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:00:21.830426 (+ 452us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:00:21.830530 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.830605 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.830662 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 07:00:21.839010 7588 raft_consensus.cc:1261] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [term 1 FOLLOWER]: Refusing update from remote peer 88651fe1408d443681d77fd15131d192: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:21.839056 7381 raft_consensus.cc:1261] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [term 1 FOLLOWER]: Refusing update from remote peer 88651fe1408d443681d77fd15131d192: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:00:21.839968 7900 consensus_queue.cc:1035] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9025466a6045b3b621265b871dc3f5" member_type: VOTER last_known_addr { host: "127.10.191.130" port: 44345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:21.840310 7898 consensus_queue.cc:1035] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d010902db8d44295b85d069c1397158e" member_type: VOTER last_known_addr { host: "127.10.191.129" port: 43719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:00:21.865463 7180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:21.865720 7180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 07:00:21.869488 7180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a93d78c1f7ad48dd91e2707e7d2544db: Sending DeleteTablet for 3 replicas of tablet de99d43f9eef4e8c9b6be900702078bb
I20260807 07:00:21.870970 7349 tablet_service.cc:1514] Processing DeleteTablet for tablet de99d43f9eef4e8c9b6be900702078bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:21 UTC) from {username='slave'} at 127.0.0.1:59074
I20260807 07:00:21.871081 7762 tablet_service.cc:1514] Processing DeleteTablet for tablet de99d43f9eef4e8c9b6be900702078bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:21 UTC) from {username='slave'} at 127.0.0.1:49978
I20260807 07:00:21.871135 7554 tablet_service.cc:1514] Processing DeleteTablet for tablet de99d43f9eef4e8c9b6be900702078bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 07:00:21 UTC) from {username='slave'} at 127.0.0.1:51252
I20260807 07:00:21.871910 7921 tablet_replica.cc:330] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: stopping tablet replica
I20260807 07:00:21.872368 7921 raft_consensus.cc:2229] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:21.872959 7921 raft_consensus.cc:2258] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:21.875098 7921 ts_tablet_manager.cc:1905] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:21.873044 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 7261
I20260807 07:00:21.882516 7921 ts_tablet_manager.cc:1918] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:21.882809 7921 log.cc:1196] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-0/wal/wals/de99d43f9eef4e8c9b6be900702078bb
I20260807 07:00:21.883447 7921 ts_tablet_manager.cc:1939] T de99d43f9eef4e8c9b6be900702078bb P d010902db8d44295b85d069c1397158e: Deleting consensus metadata
I20260807 07:00:21.886061 7157 catalog_manager.cc:4841] TS d010902db8d44295b85d069c1397158e (127.10.191.129:43719): tablet de99d43f9eef4e8c9b6be900702078bb (table test-table [id=f700f25e82d549ef915722072a29856e]) successfully deleted
I20260807 07:00:21.894147 7922 tablet_replica.cc:330] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: stopping tablet replica
I20260807 07:00:21.894398 7875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:21.876622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59076 (local address 127.10.191.129:43719)
0807 07:00:21.876888 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:21.876896 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:21.885621 (+ 8725us) server_negotiation.cc:407] Connection header received
0807 07:00:21.885954 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:21.885959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:21.886057 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:21.886164 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:21.886856 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.887993 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.890003 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:21.890630 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:21.890741 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:21.892252 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:21.892263 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:21.892280 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:21.893112 (+ 832us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:21.893172 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:21.893199 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:21.893308 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:21.893956 (+ 648us) server_negotiation.cc:299] Negotiation successful
0807 07:00:21.894058 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260807 07:00:21.895269 7445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:21.895640 7923 tablet_replica.cc:330] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: stopping tablet replica
I20260807 07:00:21.895848 7922 raft_consensus.cc:2229] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:00:21.896138 7923 raft_consensus.cc:2229] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:00:21.896708 7923 raft_consensus.cc:2258] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:21.896659 7922 raft_consensus.cc:2258] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:00:21.899277 7923 ts_tablet_manager.cc:1905] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:21.899370 7922 ts_tablet_manager.cc:1905] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 07:00:21.906203 7923 ts_tablet_manager.cc:1918] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:21.906514 7923 log.cc:1196] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-1/wal/wals/de99d43f9eef4e8c9b6be900702078bb
I20260807 07:00:21.907178 7923 ts_tablet_manager.cc:1939] T de99d43f9eef4e8c9b6be900702078bb P 2c9025466a6045b3b621265b871dc3f5: Deleting consensus metadata
I20260807 07:00:21.909299 7159 catalog_manager.cc:4841] TS 2c9025466a6045b3b621265b871dc3f5 (127.10.191.130:44345): tablet de99d43f9eef4e8c9b6be900702078bb (table test-table [id=f700f25e82d549ef915722072a29856e]) successfully deleted
I20260807 07:00:21.909500 7922 ts_tablet_manager.cc:1918] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 07:00:21.909654 7922 log.cc:1196] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: Deleting WAL directory at /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786085696003154-11006-0/minicluster-data/ts-2/wal/wals/de99d43f9eef4e8c9b6be900702078bb
I20260807 07:00:21.910292 7922 ts_tablet_manager.cc:1939] T de99d43f9eef4e8c9b6be900702078bb P 88651fe1408d443681d77fd15131d192: Deleting consensus metadata
I20260807 07:00:21.912057 7157 catalog_manager.cc:4841] TS 88651fe1408d443681d77fd15131d192 (127.10.191.131:37589): tablet de99d43f9eef4e8c9b6be900702078bb (table test-table [id=f700f25e82d549ef915722072a29856e]) successfully deleted
I20260807 07:00:21.998531 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 7261
I20260807 07:00:22.025964 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 7460
I20260807 07:00:22.033833 7877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:22.026821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.10.191.130:44345)
0807 07:00:22.027046 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:22.027052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:22.027080 (+ 28us) server_negotiation.cc:407] Connection header received
0807 07:00:22.027258 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:22.027262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:22.027345 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:22.027431 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:22.027962 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:22.028782 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:22.030609 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:22.030985 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:22.031077 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:22.032232 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:22.032241 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:22.032256 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:22.032871 (+ 615us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:22.032920 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:22.032939 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:22.033025 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:22.033390 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 07:00:22.033487 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 07:00:22.034584 7645 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:22.121259 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 7460
I20260807 07:00:22.144992 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 7655
I20260807 07:00:22.152386 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:22.146013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49994 (local address 127.10.191.131:37589)
0807 07:00:22.146207 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:22.146213 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:22.146233 (+ 20us) server_negotiation.cc:407] Connection header received
0807 07:00:22.146410 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:22.146414 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:22.146491 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:22.146633 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:22.147107 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:22.147927 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:22.149266 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:22.149689 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:22.149834 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:22.150959 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:22.150969 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:22.151001 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:22.151613 (+ 612us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:22.151658 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:22.151704 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:22.151826 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:22.151978 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 07:00:22.152081 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 07:00:22.153304 7850 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:22.277195 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 7655
I20260807 07:00:22.304850 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 7128
I20260807 07:00:22.306109 7219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:22.415694 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 7128
2026-08-07T07:00:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2852 ms)
[----------] 6 tests from EncryptionPolicyTest (22221 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:22 dist-test-slave-tfpf krb5kdc[7933](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:22 dist-test-slave-tfpf krb5kdc[7933](info): set up 2 sockets
Aug 07 07:00:22 dist-test-slave-tfpf krb5kdc[7933](info): commencing operation
krb5kdc: starting...
W20260807 07:00:23.673533 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.006s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:23 dist-test-slave-tfpf krb5kdc[7933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:23.988183 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42205
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:24.333863 7949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:24.334144 7949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:24.334311 7949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:24.340974 7949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:24.341078 7949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:24.341229 7949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:24.341331 7949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:24.341403 7949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:24.350584 7949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42205
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:24.351711 7949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:24.352952 7949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:24.364521 7954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:24.364548 7955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:24.365121 7958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:24.365773 7949 server_base.cc:1034] running on GCE node
I20260807 07:00:24.366605 7949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:24.368436 7949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:24.369665 7949 hybrid_clock.cc:648] HybridClock initialized: now 1786086024369622 us; error 59 us; skew 500 ppm
I20260807 07:00:24.370021 7949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:24 dist-test-slave-tfpf krb5kdc[7933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086024, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:24.377827 7949 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:24.379266 7949 webserver.cc:460] Webserver started at http://127.0.0.1:35637/ using document root <none> and password file <none>
I20260807 07:00:24.379921 7949 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:24.380064 7949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:24.380357 7949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:24.383241 7949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "2aa63d432b564a9dbeb2439b85cd7510"
format_stamp: "Formatted at 2026-08-07 07:00:24 on dist-test-slave-tfpf"
server_key: "a644895bd17e263bde4abab571a6ce97"
server_key_iv: "9e26969c66964068e67834642cdc5120"
server_key_version: "encryptionkey@0"
I20260807 07:00:24.383989 7949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "2aa63d432b564a9dbeb2439b85cd7510"
format_stamp: "Formatted at 2026-08-07 07:00:24 on dist-test-slave-tfpf"
server_key: "a644895bd17e263bde4abab571a6ce97"
server_key_iv: "9e26969c66964068e67834642cdc5120"
server_key_version: "encryptionkey@0"
I20260807 07:00:24.388818 7949 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 07:00:24.392030 7970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:24.393258 7949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 07:00:24.393427 7949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "2aa63d432b564a9dbeb2439b85cd7510"
format_stamp: "Formatted at 2026-08-07 07:00:24 on dist-test-slave-tfpf"
server_key: "a644895bd17e263bde4abab571a6ce97"
server_key_iv: "9e26969c66964068e67834642cdc5120"
server_key_version: "encryptionkey@0"
I20260807 07:00:24.393606 7949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:24.418795 7949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:24.422549 7949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:24.422847 7949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:24.440853 7949 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42205
I20260807 07:00:24.440898 8043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42205 every 8 connection(s)
I20260807 07:00:24.442286 7949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:24.446213 8044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:24.451792 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 7949
I20260807 07:00:24.452023 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:24.452678 11006 external_mini_cluster.cc:1428] Setting key 8c6ea371fb540c11f460909f5b8ce4bd
I20260807 07:00:24.456854 8044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510: Bootstrap starting.
I20260807 07:00:24.460610 8044 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:24.461860 8044 log.cc:824] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:24.464773 8044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510: No bootstrap required, opened a new log
Aug 07 07:00:24 dist-test-slave-tfpf krb5kdc[7933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 07:00:24.472945 8044 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aa63d432b564a9dbeb2439b85cd7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42205 } }
I20260807 07:00:24.473368 8044 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:24.473501 8044 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aa63d432b564a9dbeb2439b85cd7510, State: Initialized, Role: FOLLOWER
I20260807 07:00:24.474129 8044 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aa63d432b564a9dbeb2439b85cd7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42205 } }
I20260807 07:00:24.474400 8044 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:24.474534 8044 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:24.474730 8044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:24.476053 8051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:24.454736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35135 (local address 127.0.0.1:42205)
0807 07:00:24.455536 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:24.455547 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:24.455593 (+ 46us) server_negotiation.cc:407] Connection header received
0807 07:00:24.457356 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:24.457382 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:24.457750 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:24.458050 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:24.459920 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:24.461325 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:24.462991 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:24.463601 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:24.463717 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:24.468663 (+ 4946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:24.468670 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:24.468683 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:24.468720 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:24.471881 (+ 3161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:24.472640 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:24.472646 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:24.472652 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:24.472831 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:24.473549 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:24.473553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:24.473555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:24.474078 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:24.474449 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:24.474836 (+ 387us) server_negotiation.cc:299] Negotiation successful
0807 07:00:24.475132 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":384,"threads_started":1}
I20260807 07:00:24.477398 8044 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aa63d432b564a9dbeb2439b85cd7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42205 } }
I20260807 07:00:24.477906 8044 leader_election.cc:302] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2aa63d432b564a9dbeb2439b85cd7510; no voters:
I20260807 07:00:24.478624 8044 leader_election.cc:288] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:24.478729 8055 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:24.479916 8055 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [term 1 LEADER]: Becoming Leader. State: Replica: 2aa63d432b564a9dbeb2439b85cd7510, State: Running, Role: LEADER
I20260807 07:00:24.480033 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:24.480559 8055 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aa63d432b564a9dbeb2439b85cd7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42205 } }
I20260807 07:00:24.480921 8044 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:24.483562 8057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2aa63d432b564a9dbeb2439b85cd7510. Latest consensus state: current_term: 1 leader_uuid: "2aa63d432b564a9dbeb2439b85cd7510" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aa63d432b564a9dbeb2439b85cd7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42205 } } }
I20260807 07:00:24.483995 8057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:24.485880 8056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2aa63d432b564a9dbeb2439b85cd7510" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2aa63d432b564a9dbeb2439b85cd7510" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42205 } } }
I20260807 07:00:24.486268 8056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:24.487895 8064 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:24.494480 8064 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:24.519330 8051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:24.491607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60027 (local address 127.0.0.1:42205)
0807 07:00:24.491782 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:24.491788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:24.501626 (+ 9838us) server_negotiation.cc:407] Connection header received
0807 07:00:24.501888 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:24.501899 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:24.501975 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:24.502046 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:24.504000 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:24.505056 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:24.506814 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:24.507497 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:24.507603 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:24.510984 (+ 3381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:24.510991 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:24.510996 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:24.511030 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:24.514842 (+ 3812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:24.515849 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:24.515861 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:24.515864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:24.516010 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:24.516603 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:24.516608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:24.516611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:24.517116 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:24.517393 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:24.518730 (+ 1337us) server_negotiation.cc:299] Negotiation successful
0807 07:00:24.518907 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 07:00:24.520148 8064 catalog_manager.cc:1347] Generated new cluster ID: ceebb43df43f427dae7ea97c8648234e
I20260807 07:00:24.520303 8064 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:24.550580 8064 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:24.552444 8064 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:24.563622 8064 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2aa63d432b564a9dbeb2439b85cd7510: Generated new TSK 0
I20260807 07:00:24.564466 8064 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:24.580682 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 7949
I20260807 07:00:24.582351 8038 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:24.674746 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 7949
W20260807 07:00:24.694358 7930 connection.cc:535] client connection to 127.0.0.1:42205 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42205): Connection reset by peer (error 104)
2026-08-07T07:00:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2244 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:24 dist-test-slave-tfpf krb5kdc[8097](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:24 dist-test-slave-tfpf krb5kdc[8097](info): set up 2 sockets
Aug 07 07:00:24 dist-test-slave-tfpf krb5kdc[8097](info): commencing operation
krb5kdc: starting...
W20260807 07:00:25.953486 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.002s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:26 dist-test-slave-tfpf krb5kdc[8097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:26.262099 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44905
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:26.594175 8116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:26.594417 8116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:26.594496 8116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:26.601205 8116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:26.601300 8116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:26.601344 8116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:26.601402 8116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:26.601439 8116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:26.610386 8116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44905
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:26.611544 8116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:26.612787 8116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:26.624136 8123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:26.624197 8128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:26.624104 8124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:26.625144 8116 server_base.cc:1034] running on GCE node
I20260807 07:00:26.625907 8116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:26.627188 8116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:26.628417 8116 hybrid_clock.cc:648] HybridClock initialized: now 1786086026628367 us; error 36 us; skew 500 ppm
I20260807 07:00:26.628762 8116 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:26 dist-test-slave-tfpf krb5kdc[8097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086026, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:26.631930 8116 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:26.633383 8116 webserver.cc:460] Webserver started at http://127.0.0.1:41991/ using document root <none> and password file <none>
I20260807 07:00:26.633997 8116 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:26.634150 8116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:26.634500 8116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:26.637408 8116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "7edd51295c83404583aac382bb8beafc"
format_stamp: "Formatted at 2026-08-07 07:00:26 on dist-test-slave-tfpf"
server_key: "552c516ff230442a751541d117a7a94c"
server_key_iv: "c348d256f55f62730a09c2d4f6c9a157"
server_key_version: "encryptionkey@0"
I20260807 07:00:26.638188 8116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "7edd51295c83404583aac382bb8beafc"
format_stamp: "Formatted at 2026-08-07 07:00:26 on dist-test-slave-tfpf"
server_key: "552c516ff230442a751541d117a7a94c"
server_key_iv: "c348d256f55f62730a09c2d4f6c9a157"
server_key_version: "encryptionkey@0"
I20260807 07:00:26.643239 8116 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 07:00:26.646721 8136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:26.648070 8116 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 07:00:26.648290 8116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "7edd51295c83404583aac382bb8beafc"
format_stamp: "Formatted at 2026-08-07 07:00:26 on dist-test-slave-tfpf"
server_key: "552c516ff230442a751541d117a7a94c"
server_key_iv: "c348d256f55f62730a09c2d4f6c9a157"
server_key_version: "encryptionkey@0"
I20260807 07:00:26.648500 8116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:26.659951 8116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:26.663856 8116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:26.664144 8116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:26.682372 8116 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44905
I20260807 07:00:26.682451 8220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44905 every 8 connection(s)
I20260807 07:00:26.683704 8116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:26.687316 8221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:26.689489 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 8116
I20260807 07:00:26.689702 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:26.690299 11006 external_mini_cluster.cc:1428] Setting key 7f067b45d81a6e005f3f6bfb3d8d8366
I20260807 07:00:26.701570 8221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc: Bootstrap starting.
I20260807 07:00:26.703300 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:26.692029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58637 (local address 127.0.0.1:44905)
0807 07:00:26.692824 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:26.692833 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:26.692881 (+ 48us) server_negotiation.cc:407] Connection header received
0807 07:00:26.694425 (+ 1544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:26.694448 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:26.694794 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:26.695073 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:26.695714 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:26.696926 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:26.698950 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:26.699596 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:26.699722 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:26.701039 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:26.701046 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:26.701057 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:26.701607 (+ 550us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:26.701730 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:26.701756 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:26.701895 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:26.702199 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 07:00:26.702379 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":391,"threads_started":1}
I20260807 07:00:26.705013 8221 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:26.706249 8221 log.cc:824] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:26.706969 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:26.708889 8221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc: No bootstrap required, opened a new log
I20260807 07:00:26.718047 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:26.711403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37047 (local address 127.0.0.1:44905)
0807 07:00:26.711574 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:26.711580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:26.711998 (+ 418us) server_negotiation.cc:407] Connection header received
0807 07:00:26.712188 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:26.712193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:26.712277 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:26.712385 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:26.712819 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:26.713968 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:26.715218 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:26.715953 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:26.716089 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:26.717094 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:26.717102 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:26.717107 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:26.717129 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:26.717197 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:26.717226 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:26.717363 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:26.717586 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 07:00:26.717641 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 07:00:26.717783 8221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7edd51295c83404583aac382bb8beafc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } }
I20260807 07:00:26.718263 8221 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:26.718413 8221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7edd51295c83404583aac382bb8beafc, State: Initialized, Role: FOLLOWER
I20260807 07:00:26.719004 8221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7edd51295c83404583aac382bb8beafc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } }
I20260807 07:00:26.719291 8221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:26.719468 8221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:26.719671 8221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:26.722007 8221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7edd51295c83404583aac382bb8beafc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } }
I20260807 07:00:26.722589 8221 leader_election.cc:302] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7edd51295c83404583aac382bb8beafc; no voters:
I20260807 07:00:26.723168 8221 leader_election.cc:288] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:26.723271 8233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:26.724912 8233 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [term 1 LEADER]: Becoming Leader. State: Replica: 7edd51295c83404583aac382bb8beafc, State: Running, Role: LEADER
I20260807 07:00:26.725558 8233 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7edd51295c83404583aac382bb8beafc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } }
I20260807 07:00:26.725775 8221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:26.728610 8237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7edd51295c83404583aac382bb8beafc. Latest consensus state: current_term: 1 leader_uuid: "7edd51295c83404583aac382bb8beafc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7edd51295c83404583aac382bb8beafc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } } }
I20260807 07:00:26.728658 8235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7edd51295c83404583aac382bb8beafc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7edd51295c83404583aac382bb8beafc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44905 } } }
I20260807 07:00:26.729106 8237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:26.729106 8235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:26.731619 8243 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:26.735891 8243 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:26.744961 8243 catalog_manager.cc:1347] Generated new cluster ID: 99eda7f618bf48a7ac07cd998f0faa2f
I20260807 07:00:26.745080 8243 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:26.760324 8243 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:26.761982 8243 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:26.773782 8243 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7edd51295c83404583aac382bb8beafc: Generated new TSK 0
I20260807 07:00:26.774724 8243 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:26.780033 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8116
W20260807 07:00:26.781209 8213 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58637
W20260807 07:00:26.782011 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8116: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:26.782222 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 8116
W20260807 07:00:26.808996 8094 connection.cc:535] client connection to 127.0.0.1:44905 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44905): Connection reset by peer (error 104)
2026-08-07T07:00:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2114 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:26 dist-test-slave-tfpf krb5kdc[8271](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:26 dist-test-slave-tfpf krb5kdc[8271](info): set up 2 sockets
Aug 07 07:00:26 dist-test-slave-tfpf krb5kdc[8271](info): commencing operation
krb5kdc: starting...
W20260807 07:00:28.048842 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.005s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:28 dist-test-slave-tfpf krb5kdc[8271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:28.356171 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38525
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:28.714262 8287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:28.714533 8287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:28.714620 8287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:28.721684 8287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:28.721832 8287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:28.721887 8287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:28.721971 8287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:28.722025 8287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:28.732076 8287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38525
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:28.733398 8287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:28.734676 8287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:28.746953 8295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:28.746971 8297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:28.747273 8300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:28.748265 8287 server_base.cc:1034] running on GCE node
I20260807 07:00:28.749014 8287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:28.750459 8287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:28.751663 8287 hybrid_clock.cc:648] HybridClock initialized: now 1786086028751606 us; error 52 us; skew 500 ppm
I20260807 07:00:28.751974 8287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:28 dist-test-slave-tfpf krb5kdc[8271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086028, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:28.755045 8287 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:28.756485 8287 webserver.cc:460] Webserver started at http://127.0.0.1:45629/ using document root <none> and password file <none>
I20260807 07:00:28.757269 8287 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:28.757438 8287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:28.757797 8287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:28.760957 8287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "0eda1061e8d9473aa87ad8c60b2709e3"
format_stamp: "Formatted at 2026-08-07 07:00:28 on dist-test-slave-tfpf"
server_key: "e1e39ed758147922186e2177b4eb9c38"
server_key_iv: "e05a01fb55a3a4a171d48e60d4279ff7"
server_key_version: "encryptionkey@0"
I20260807 07:00:28.761824 8287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "0eda1061e8d9473aa87ad8c60b2709e3"
format_stamp: "Formatted at 2026-08-07 07:00:28 on dist-test-slave-tfpf"
server_key: "e1e39ed758147922186e2177b4eb9c38"
server_key_iv: "e05a01fb55a3a4a171d48e60d4279ff7"
server_key_version: "encryptionkey@0"
I20260807 07:00:28.768631 8287 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260807 07:00:28.772260 8311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:28.773514 8287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 07:00:28.773700 8287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "0eda1061e8d9473aa87ad8c60b2709e3"
format_stamp: "Formatted at 2026-08-07 07:00:28 on dist-test-slave-tfpf"
server_key: "e1e39ed758147922186e2177b4eb9c38"
server_key_iv: "e05a01fb55a3a4a171d48e60d4279ff7"
server_key_version: "encryptionkey@0"
I20260807 07:00:28.773904 8287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:28.779800 8287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:28.783667 8287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:28.783991 8287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:28.803545 8287 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38525
I20260807 07:00:28.803591 8389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38525 every 8 connection(s)
I20260807 07:00:28.805018 8287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:28.806802 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 8287
I20260807 07:00:28.807041 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:28.807565 11006 external_mini_cluster.cc:1428] Setting key cbc9b4fd723e530832440b5d9ec1b612
I20260807 07:00:28.809406 8390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:28.816124 8393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:28.809497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58687 (local address 127.0.0.1:38525)
0807 07:00:28.810346 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:28.810362 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:28.810414 (+ 52us) server_negotiation.cc:407] Connection header received
0807 07:00:28.812476 (+ 2062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:28.812500 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:28.812913 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:28.813330 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:28.814255 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:28.814262 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:28.814279 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:28.814299 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:28.814385 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:28.814408 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:28.814654 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:28.814787 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 07:00:28.814966 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":347,"threads_started":1}
I20260807 07:00:28.819960 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:28.822681 8390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3: Bootstrap starting.
I20260807 07:00:28.825944 8390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:28.826992 8393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:28.824531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44989 (local address 127.0.0.1:38525)
0807 07:00:28.824702 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:28.824708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:28.824956 (+ 248us) server_negotiation.cc:407] Connection header received
0807 07:00:28.825227 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:28.825231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:28.825272 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:28.825368 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:28.826303 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:28.826308 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:28.826314 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:28.826351 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:28.826388 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:28.826403 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:28.826535 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:28.826642 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 07:00:28.826700 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 07:00:28.827301 8390 log.cc:824] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:28.830058 8390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3: No bootstrap required, opened a new log
I20260807 07:00:28.837101 8390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eda1061e8d9473aa87ad8c60b2709e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260807 07:00:28.837479 8390 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:28.837569 8390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eda1061e8d9473aa87ad8c60b2709e3, State: Initialized, Role: FOLLOWER
I20260807 07:00:28.838107 8390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eda1061e8d9473aa87ad8c60b2709e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260807 07:00:28.838394 8390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:28.838547 8390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:28.838714 8390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:28.840731 8390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eda1061e8d9473aa87ad8c60b2709e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260807 07:00:28.841256 8390 leader_election.cc:302] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0eda1061e8d9473aa87ad8c60b2709e3; no voters:
I20260807 07:00:28.841820 8390 leader_election.cc:288] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:28.841917 8402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:28.843392 8402 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0eda1061e8d9473aa87ad8c60b2709e3, State: Running, Role: LEADER
I20260807 07:00:28.843919 8390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:28.843904 8402 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eda1061e8d9473aa87ad8c60b2709e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } }
I20260807 07:00:28.846999 8403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0eda1061e8d9473aa87ad8c60b2709e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eda1061e8d9473aa87ad8c60b2709e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } } }
I20260807 07:00:28.846951 8404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0eda1061e8d9473aa87ad8c60b2709e3. Latest consensus state: current_term: 1 leader_uuid: "0eda1061e8d9473aa87ad8c60b2709e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0eda1061e8d9473aa87ad8c60b2709e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38525 } } }
I20260807 07:00:28.847422 8404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:28.847419 8403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:28.849105 8417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:28.854679 8417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:28.862735 8417 catalog_manager.cc:1347] Generated new cluster ID: 752d05c0a33d4dd18cebcffabf9305eb
I20260807 07:00:28.862825 8417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:28.882875 8417 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:28.883265 8417 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:28.895220 8417 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0eda1061e8d9473aa87ad8c60b2709e3: Generated new TSK 0
I20260807 07:00:28.895870 8417 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:28.906673 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8287
W20260807 07:00:28.907931 8384 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58687
W20260807 07:00:28.908828 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8287: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:28.909008 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 8287
2026-08-07T07:00:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2126 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:29 dist-test-slave-tfpf krb5kdc[8440](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:29 dist-test-slave-tfpf krb5kdc[8440](info): set up 2 sockets
Aug 07 07:00:29 dist-test-slave-tfpf krb5kdc[8440](info): commencing operation
krb5kdc: starting...
W20260807 07:00:30.170642 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:30 dist-test-slave-tfpf krb5kdc[8440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:30.452195 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45083
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:30.788928 8462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:30.789306 8462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:30.789476 8462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:30.796396 8462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:30.796492 8462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:30.796594 8462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:30.796706 8462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:30.796808 8462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:30.806003 8462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:30.807231 8462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:30.808543 8462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:30.819790 8471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:30.819857 8472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:30.820109 8474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:30.820822 8462 server_base.cc:1034] running on GCE node
I20260807 07:00:30.821534 8462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:30.822724 8462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:30.823910 8462 hybrid_clock.cc:648] HybridClock initialized: now 1786086030823864 us; error 41 us; skew 500 ppm
I20260807 07:00:30.824189 8462 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:30 dist-test-slave-tfpf krb5kdc[8440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086030, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:30.830278 8462 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:30.831634 8462 webserver.cc:460] Webserver started at http://127.0.0.1:45451/ using document root <none> and password file <none>
I20260807 07:00:30.832262 8462 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:30.832381 8462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:30.832623 8462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:30.835521 8462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "ed1016c4c2aa46249ac49c43b45fd667"
format_stamp: "Formatted at 2026-08-07 07:00:30 on dist-test-slave-tfpf"
server_key: "c9161181520f13c052334e2d101dbabb"
server_key_iv: "d94ab2ebe07fb4b1a1d24f3d19b66d9d"
server_key_version: "encryptionkey@0"
I20260807 07:00:30.836215 8462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "ed1016c4c2aa46249ac49c43b45fd667"
format_stamp: "Formatted at 2026-08-07 07:00:30 on dist-test-slave-tfpf"
server_key: "c9161181520f13c052334e2d101dbabb"
server_key_iv: "d94ab2ebe07fb4b1a1d24f3d19b66d9d"
server_key_version: "encryptionkey@0"
I20260807 07:00:30.841230 8462 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260807 07:00:30.844532 8485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:30.845811 8462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 07:00:30.846002 8462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "ed1016c4c2aa46249ac49c43b45fd667"
format_stamp: "Formatted at 2026-08-07 07:00:30 on dist-test-slave-tfpf"
server_key: "c9161181520f13c052334e2d101dbabb"
server_key_iv: "d94ab2ebe07fb4b1a1d24f3d19b66d9d"
server_key_version: "encryptionkey@0"
I20260807 07:00:30.846199 8462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:30.866325 8462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:30.870478 8462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:30.870769 8462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:30.889698 8462 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45083
I20260807 07:00:30.889776 8574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45083 every 8 connection(s)
I20260807 07:00:30.891026 8462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:30.893174 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 8462
I20260807 07:00:30.893386 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:30.893934 11006 external_mini_cluster.cc:1428] Setting key e33c3bab782539ea781964073a379091
I20260807 07:00:30.895264 8576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 07:00:30 dist-test-slave-tfpf krb5kdc[8440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 07:00:30.909145 8576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667: Bootstrap starting.
I20260807 07:00:30.912166 8576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:30.913234 8576 log.cc:824] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:30.915889 8576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667: No bootstrap required, opened a new log
I20260807 07:00:30.916589 8583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:30.895663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33885 (local address 127.0.0.1:45083)
0807 07:00:30.896450 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:30.896460 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:30.896499 (+ 39us) server_negotiation.cc:407] Connection header received
0807 07:00:30.898147 (+ 1648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:30.898175 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:30.898550 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:30.898871 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:30.900741 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:30.902108 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:30.903904 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:30.904558 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:30.904698 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:30.909390 (+ 4692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:30.909398 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:30.909410 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:30.909445 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:30.912507 (+ 3062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:30.913240 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:30.913246 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:30.913252 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:30.913489 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:30.913894 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:30.913900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:30.913903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:30.914443 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:30.914735 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:30.915187 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 07:00:30.915564 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":368,"threads_started":1}
I20260807 07:00:30.920326 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:30.923828 8576 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed1016c4c2aa46249ac49c43b45fd667" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } }
I20260807 07:00:30.924172 8576 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:30.924337 8576 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed1016c4c2aa46249ac49c43b45fd667, State: Initialized, Role: FOLLOWER
I20260807 07:00:30.925046 8576 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed1016c4c2aa46249ac49c43b45fd667" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } }
I20260807 07:00:30.925338 8576 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:30.925503 8576 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:30.925696 8576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:30.927722 8576 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed1016c4c2aa46249ac49c43b45fd667" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } }
I20260807 07:00:30.928206 8576 leader_election.cc:302] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed1016c4c2aa46249ac49c43b45fd667; no voters:
I20260807 07:00:30.928900 8576 leader_election.cc:288] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:30.928990 8592 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:30.931370 8576 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:30.936079 8592 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [term 1 LEADER]: Becoming Leader. State: Replica: ed1016c4c2aa46249ac49c43b45fd667, State: Running, Role: LEADER
I20260807 07:00:30.936800 8592 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed1016c4c2aa46249ac49c43b45fd667" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } }
I20260807 07:00:30.939042 8583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:30.924820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45147 (local address 127.0.0.1:45083)
0807 07:00:30.925001 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:30.925006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:30.925352 (+ 346us) server_negotiation.cc:407] Connection header received
0807 07:00:30.925593 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:30.925597 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:30.925670 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:30.925780 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:30.927124 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:30.927819 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:30.929324 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:30.930012 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:30.930101 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:30.932628 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:30.932634 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:30.932639 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:30.932681 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:30.935862 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:30.936587 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:30.936592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:30.936596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:30.936835 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:30.937347 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:30.937355 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:30.937361 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:30.937782 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:30.938100 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:30.938423 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 07:00:30.938680 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 07:00:30.943534 8595 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed1016c4c2aa46249ac49c43b45fd667. Latest consensus state: current_term: 1 leader_uuid: "ed1016c4c2aa46249ac49c43b45fd667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed1016c4c2aa46249ac49c43b45fd667" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } } }
I20260807 07:00:30.943895 8594 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed1016c4c2aa46249ac49c43b45fd667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed1016c4c2aa46249ac49c43b45fd667" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } } }
I20260807 07:00:30.944141 8595 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:30.944203 8594 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:30.946028 8607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:30.950795 8607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:30.959622 8607 catalog_manager.cc:1347] Generated new cluster ID: 3e2380132e184837978e22f65d38d725
I20260807 07:00:30.959751 8607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:30.978396 8607 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:30.980842 8607 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:30.991799 8607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed1016c4c2aa46249ac49c43b45fd667: Generated new TSK 0
I20260807 07:00:30.992588 8607 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:31.001778 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8462
I20260807 07:00:31.002919 8569 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:31.089479 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 8462
2026-08-07T07:00:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2177 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:31 dist-test-slave-tfpf krb5kdc[8624](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:31 dist-test-slave-tfpf krb5kdc[8624](info): set up 2 sockets
Aug 07 07:00:31 dist-test-slave-tfpf krb5kdc[8624](info): commencing operation
krb5kdc: starting...
W20260807 07:00:32.360484 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.007s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:32 dist-test-slave-tfpf krb5kdc[8624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:32.656461 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37931
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37931
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:32.981719 8643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:32.982040 8643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:32.982194 8643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:32.988682 8643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:32.988816 8643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:32.988862 8643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:32.988924 8643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:32.988967 8643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:32.998267 8643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:32.999684 8643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:33.000912 8643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:33.012826 8656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:33.012921 8655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:33.012898 8660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:33.013711 8643 server_base.cc:1034] running on GCE node
I20260807 07:00:33.014420 8643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:33.015717 8643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:33.016950 8643 hybrid_clock.cc:648] HybridClock initialized: now 1786086033016914 us; error 32 us; skew 500 ppm
I20260807 07:00:33.017355 8643 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:33 dist-test-slave-tfpf krb5kdc[8624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086033, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:33.020457 8643 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:33.021879 8643 webserver.cc:460] Webserver started at http://127.0.0.1:45323/ using document root <none> and password file <none>
I20260807 07:00:33.022548 8643 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:33.022701 8643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:33.023007 8643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:33.025935 8643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "0a2695dce343419bbd7f07629cba52f4"
format_stamp: "Formatted at 2026-08-07 07:00:33 on dist-test-slave-tfpf"
server_key: "0f4db613efdb7ae46a84a89652547e63"
server_key_iv: "b6b347604276b043dcfa91e7b1894905"
server_key_version: "encryptionkey@0"
I20260807 07:00:33.026775 8643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "0a2695dce343419bbd7f07629cba52f4"
format_stamp: "Formatted at 2026-08-07 07:00:33 on dist-test-slave-tfpf"
server_key: "0f4db613efdb7ae46a84a89652547e63"
server_key_iv: "b6b347604276b043dcfa91e7b1894905"
server_key_version: "encryptionkey@0"
I20260807 07:00:33.031949 8643 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 07:00:33.035379 8675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:33.036723 8643 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 07:00:33.036954 8643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "0a2695dce343419bbd7f07629cba52f4"
format_stamp: "Formatted at 2026-08-07 07:00:33 on dist-test-slave-tfpf"
server_key: "0f4db613efdb7ae46a84a89652547e63"
server_key_iv: "b6b347604276b043dcfa91e7b1894905"
server_key_version: "encryptionkey@0"
I20260807 07:00:33.037207 8643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:33.050571 8643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:33.054046 8643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:33.054281 8643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:33.072659 8643 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37931
I20260807 07:00:33.072697 8754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37931 every 8 connection(s)
I20260807 07:00:33.074074 8643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:33.077742 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 8643
I20260807 07:00:33.077924 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:33.078003 8755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:33.078435 11006 external_mini_cluster.cc:1428] Setting key 25679c39c5f150ce40ae82bc787e5449
I20260807 07:00:33.091392 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:33.080127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55767 (local address 127.0.0.1:37931)
0807 07:00:33.080916 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:33.080930 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:33.080972 (+ 42us) server_negotiation.cc:407] Connection header received
0807 07:00:33.082817 (+ 1845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:33.082837 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:33.083205 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:33.083522 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:33.084124 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:33.085412 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:33.087190 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:33.087825 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:33.088022 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:33.089325 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:33.089334 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:33.089346 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:33.089862 (+ 516us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:33.089943 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:33.089969 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:33.090068 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:33.090288 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 07:00:33.090536 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":364,"threads_started":1}
I20260807 07:00:33.091943 8755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4: Bootstrap starting.
I20260807 07:00:33.094813 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:33.095286 8755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:33.096259 8755 log.cc:824] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:33.099040 8755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4: No bootstrap required, opened a new log
I20260807 07:00:33.105644 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:33.099385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35769 (local address 127.0.0.1:37931)
0807 07:00:33.099597 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:33.099602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:33.099927 (+ 325us) server_negotiation.cc:407] Connection header received
0807 07:00:33.100066 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:33.100071 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:33.100140 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:33.100253 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:33.100687 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:33.101799 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:33.103115 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:33.103778 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:33.103923 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:33.104838 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:33.104848 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:33.104853 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:33.104872 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:33.104924 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:33.104943 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:33.105039 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:33.105236 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 07:00:33.105331 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 07:00:33.108036 8755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a2695dce343419bbd7f07629cba52f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } }
I20260807 07:00:33.108374 8755 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:33.108496 8755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a2695dce343419bbd7f07629cba52f4, State: Initialized, Role: FOLLOWER
I20260807 07:00:33.109025 8755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a2695dce343419bbd7f07629cba52f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } }
I20260807 07:00:33.109330 8755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:33.109498 8755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:33.109706 8755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:33.111752 8755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a2695dce343419bbd7f07629cba52f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } }
I20260807 07:00:33.112275 8755 leader_election.cc:302] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a2695dce343419bbd7f07629cba52f4; no voters:
I20260807 07:00:33.112881 8755 leader_election.cc:288] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:33.113011 8769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:33.113847 8769 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [term 1 LEADER]: Becoming Leader. State: Replica: 0a2695dce343419bbd7f07629cba52f4, State: Running, Role: LEADER
I20260807 07:00:33.114374 8769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a2695dce343419bbd7f07629cba52f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } }
I20260807 07:00:33.115023 8755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:33.117306 8772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a2695dce343419bbd7f07629cba52f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a2695dce343419bbd7f07629cba52f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } } }
I20260807 07:00:33.117712 8772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:33.117419 8776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a2695dce343419bbd7f07629cba52f4. Latest consensus state: current_term: 1 leader_uuid: "0a2695dce343419bbd7f07629cba52f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a2695dce343419bbd7f07629cba52f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37931 } } }
I20260807 07:00:33.117846 8776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4 [sys.catalog]: This master's current role is: LEADER
W20260807 07:00:33.127533 8803 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 07:00:33.127709 8803 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 07:00:33.128275 8784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:33.130532 8784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:33.138315 8784 catalog_manager.cc:1347] Generated new cluster ID: 19bcf3dfb858437da0501cbb58c8bbff
I20260807 07:00:33.138413 8784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:33.153602 8784 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:33.155349 8784 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:33.162889 8784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a2695dce343419bbd7f07629cba52f4: Generated new TSK 0
I20260807 07:00:33.163790 8784 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:33.179883 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8643
W20260807 07:00:33.181289 8749 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55767
W20260807 07:00:33.181905 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8643: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:33.182046 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 8643
2026-08-07T07:00:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2094 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:33 dist-test-slave-tfpf krb5kdc[8808](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:33 dist-test-slave-tfpf krb5kdc[8808](info): set up 2 sockets
Aug 07 07:00:33 dist-test-slave-tfpf krb5kdc[8808](info): commencing operation
krb5kdc: starting...
W20260807 07:00:34.440488 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:34 dist-test-slave-tfpf krb5kdc[8808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:34.733484 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45071
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:35.065141 8826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:35.065393 8826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:35.065476 8826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:35.072044 8826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:35.072153 8826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:35.072204 8826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:35.072256 8826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:35.072296 8826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:35.081604 8826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:35.082692 8826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:35.083879 8826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:35.094866 8832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:35.094987 8833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:35.095017 8837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:35.095798 8826 server_base.cc:1034] running on GCE node
I20260807 07:00:35.096565 8826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:35.097913 8826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:35.099135 8826 hybrid_clock.cc:648] HybridClock initialized: now 1786086035099142 us; error 103 us; skew 500 ppm
I20260807 07:00:35.099460 8826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:35 dist-test-slave-tfpf krb5kdc[8808](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086035, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:35.102416 8826 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:35.103711 8826 webserver.cc:460] Webserver started at http://127.0.0.1:43561/ using document root <none> and password file <none>
I20260807 07:00:35.104328 8826 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:35.104465 8826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:35.104758 8826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:35.107652 8826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "1a8cf67f7689443a8cecf7094db78f5d"
format_stamp: "Formatted at 2026-08-07 07:00:35 on dist-test-slave-tfpf"
server_key: "b603bb3ddc5602fe19e2babf7af51271"
server_key_iv: "5e488dbfa90aeee05390b92b476fc4e2"
server_key_version: "encryptionkey@0"
I20260807 07:00:35.108364 8826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "1a8cf67f7689443a8cecf7094db78f5d"
format_stamp: "Formatted at 2026-08-07 07:00:35 on dist-test-slave-tfpf"
server_key: "b603bb3ddc5602fe19e2babf7af51271"
server_key_iv: "5e488dbfa90aeee05390b92b476fc4e2"
server_key_version: "encryptionkey@0"
I20260807 07:00:35.113473 8826 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260807 07:00:35.116694 8846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:35.118105 8826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 07:00:35.118254 8826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "1a8cf67f7689443a8cecf7094db78f5d"
format_stamp: "Formatted at 2026-08-07 07:00:35 on dist-test-slave-tfpf"
server_key: "b603bb3ddc5602fe19e2babf7af51271"
server_key_iv: "5e488dbfa90aeee05390b92b476fc4e2"
server_key_version: "encryptionkey@0"
I20260807 07:00:35.118419 8826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:35.123847 8826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:35.127626 8826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:35.127878 8826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:35.145432 8826 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45071
I20260807 07:00:35.145506 8918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45071 every 8 connection(s)
I20260807 07:00:35.146719 8826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:35.148550 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 8826
I20260807 07:00:35.148767 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:35.149415 11006 external_mini_cluster.cc:1428] Setting key 9c299117f67c28d433c8909550df385b
I20260807 07:00:35.151119 8919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:35.157017 8922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:35.151214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57477 (local address 127.0.0.1:45071)
0807 07:00:35.151972 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:35.151982 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:35.152021 (+ 39us) server_negotiation.cc:407] Connection header received
0807 07:00:35.153673 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:35.153693 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:35.154010 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:35.154407 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:35.155434 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:35.155442 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:35.155457 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:35.155473 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:35.155539 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:35.155561 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:35.155801 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:35.155937 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 07:00:35.156126 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":347,"threads_started":1}
I20260807 07:00:35.160679 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:35.163125 8919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d: Bootstrap starting.
I20260807 07:00:35.166821 8919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:35.167198 8922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:35.164966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50877 (local address 127.0.0.1:45071)
0807 07:00:35.165141 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:35.165147 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:35.165489 (+ 342us) server_negotiation.cc:407] Connection header received
0807 07:00:35.165591 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:35.165595 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:35.165648 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:35.165755 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:35.166579 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:35.166584 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:35.166589 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:35.166611 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:35.166655 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:35.166690 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:35.166825 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:35.166876 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 07:00:35.166929 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 07:00:35.168006 8919 log.cc:824] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:35.170681 8919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d: No bootstrap required, opened a new log
I20260807 07:00:35.176985 8919 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a8cf67f7689443a8cecf7094db78f5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45071 } }
I20260807 07:00:35.177408 8919 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:35.177546 8919 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a8cf67f7689443a8cecf7094db78f5d, State: Initialized, Role: FOLLOWER
I20260807 07:00:35.178128 8919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a8cf67f7689443a8cecf7094db78f5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45071 } }
I20260807 07:00:35.178392 8919 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:35.178548 8919 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:35.178730 8919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:35.180730 8919 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a8cf67f7689443a8cecf7094db78f5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45071 } }
I20260807 07:00:35.181255 8919 leader_election.cc:302] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a8cf67f7689443a8cecf7094db78f5d; no voters:
I20260807 07:00:35.181885 8919 leader_election.cc:288] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:35.182027 8931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:35.183141 8931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [term 1 LEADER]: Becoming Leader. State: Replica: 1a8cf67f7689443a8cecf7094db78f5d, State: Running, Role: LEADER
I20260807 07:00:35.183569 8931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a8cf67f7689443a8cecf7094db78f5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45071 } }
I20260807 07:00:35.183702 8919 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:35.186301 8932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a8cf67f7689443a8cecf7094db78f5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a8cf67f7689443a8cecf7094db78f5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45071 } } }
I20260807 07:00:35.186480 8933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a8cf67f7689443a8cecf7094db78f5d. Latest consensus state: current_term: 1 leader_uuid: "1a8cf67f7689443a8cecf7094db78f5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a8cf67f7689443a8cecf7094db78f5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45071 } } }
I20260807 07:00:35.186671 8932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:35.186733 8933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:35.187507 8940 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:35.193022 8940 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:35.201635 8940 catalog_manager.cc:1347] Generated new cluster ID: 5f1c87878faa4b03a7b12be36fb7c2da
I20260807 07:00:35.201725 8940 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:35.239380 8940 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:35.239837 8940 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:35.251348 8940 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a8cf67f7689443a8cecf7094db78f5d: Generated new TSK 0
I20260807 07:00:35.252075 8940 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:35.258358 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8826
W20260807 07:00:35.259567 8914 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57477
W20260807 07:00:35.260368 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8826: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:35.260514 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 8826
2026-08-07T07:00:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2082 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:35 dist-test-slave-tfpf krb5kdc[8953](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:35 dist-test-slave-tfpf krb5kdc[8953](info): set up 2 sockets
Aug 07 07:00:35 dist-test-slave-tfpf krb5kdc[8953](info): commencing operation
krb5kdc: starting...
W20260807 07:00:36.543255 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.002s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:36 dist-test-slave-tfpf krb5kdc[8953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:36.853962 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:37.191151 8975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:37.191386 8975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:37.191464 8975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:37.197691 8975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:37.197816 8975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:37.197935 8975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:37.198066 8975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:37.198151 8975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:37.207748 8975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:37.209209 8975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:37.210620 8975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:37.223228 8990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:37.223282 8992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:37.223320 8989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:37.224192 8975 server_base.cc:1034] running on GCE node
I20260807 07:00:37.224951 8975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:37.226392 8975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:37.227641 8975 hybrid_clock.cc:648] HybridClock initialized: now 1786086037227586 us; error 59 us; skew 500 ppm
I20260807 07:00:37.228004 8975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:37 dist-test-slave-tfpf krb5kdc[8953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086037, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:37.235636 8975 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:37.237254 8975 webserver.cc:460] Webserver started at http://127.0.0.1:44295/ using document root <none> and password file <none>
I20260807 07:00:37.237948 8975 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:37.238101 8975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:37.238417 8975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:37.241469 8975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "4ca8d54012fb4deb9dfa36efcee49d79"
format_stamp: "Formatted at 2026-08-07 07:00:37 on dist-test-slave-tfpf"
server_key: "aed06bc7f9814fe1c318fbe985c98b74"
server_key_iv: "e2648e5063f47f19c9b09a4b64ed1783"
server_key_version: "encryptionkey@0"
I20260807 07:00:37.242241 8975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "4ca8d54012fb4deb9dfa36efcee49d79"
format_stamp: "Formatted at 2026-08-07 07:00:37 on dist-test-slave-tfpf"
server_key: "aed06bc7f9814fe1c318fbe985c98b74"
server_key_iv: "e2648e5063f47f19c9b09a4b64ed1783"
server_key_version: "encryptionkey@0"
I20260807 07:00:37.247280 8975 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 07:00:37.250800 9001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:37.252012 8975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 07:00:37.252197 8975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "4ca8d54012fb4deb9dfa36efcee49d79"
format_stamp: "Formatted at 2026-08-07 07:00:37 on dist-test-slave-tfpf"
server_key: "aed06bc7f9814fe1c318fbe985c98b74"
server_key_iv: "e2648e5063f47f19c9b09a4b64ed1783"
server_key_version: "encryptionkey@0"
I20260807 07:00:37.252393 8975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:37.281312 8975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:37.285264 8975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:37.285591 8975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:37.305307 8975 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41431
I20260807 07:00:37.305331 9080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41431 every 8 connection(s)
I20260807 07:00:37.306735 8975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:37.310621 9081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:37.312387 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 8975
I20260807 07:00:37.312603 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:37.313234 11006 external_mini_cluster.cc:1428] Setting key 84fa41edd3ab65cbe932d1c3afe3a15e
I20260807 07:00:37.323860 9081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79: Bootstrap starting.
Aug 07 07:00:37 dist-test-slave-tfpf krb5kdc[8953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 07:00:37.327345 9081 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:37.328431 9081 log.cc:824] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:37.331745 9081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79: No bootstrap required, opened a new log
I20260807 07:00:37.336321 9087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:37.315338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:56837 (local address 127.0.0.1:41431)
0807 07:00:37.316218 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:37.316229 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:37.316270 (+ 41us) server_negotiation.cc:407] Connection header received
0807 07:00:37.317945 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:37.317976 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:37.318352 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:37.318717 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:37.320230 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:37.321584 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:37.322874 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:37.323553 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:37.323735 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:37.328211 (+ 4476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:37.328218 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:37.328230 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:37.328263 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:37.331702 (+ 3439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:37.332635 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:37.332745 (+ 110us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:37.332752 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:37.332959 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:37.333560 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:37.333566 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:37.333571 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:37.334111 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:37.334481 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:37.335025 (+ 544us) server_negotiation.cc:299] Negotiation successful
0807 07:00:37.335338 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":441,"threads_started":1}
I20260807 07:00:37.340466 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:37.340989 9081 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca8d54012fb4deb9dfa36efcee49d79" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260807 07:00:37.341435 9081 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:37.341542 9081 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca8d54012fb4deb9dfa36efcee49d79, State: Initialized, Role: FOLLOWER
I20260807 07:00:37.342139 9081 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca8d54012fb4deb9dfa36efcee49d79" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260807 07:00:37.342398 9081 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:37.342541 9081 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:37.342722 9081 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:37.345028 9081 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca8d54012fb4deb9dfa36efcee49d79" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260807 07:00:37.345664 9081 leader_election.cc:302] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ca8d54012fb4deb9dfa36efcee49d79; no voters:
I20260807 07:00:37.346383 9081 leader_election.cc:288] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:37.346488 9101 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:37.348729 9081 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:37.349342 9101 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [term 1 LEADER]: Becoming Leader. State: Replica: 4ca8d54012fb4deb9dfa36efcee49d79, State: Running, Role: LEADER
I20260807 07:00:37.349989 9101 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca8d54012fb4deb9dfa36efcee49d79" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260807 07:00:37.352523 9102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ca8d54012fb4deb9dfa36efcee49d79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca8d54012fb4deb9dfa36efcee49d79" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } } }
I20260807 07:00:37.352998 9102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:37.357829 9108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:37.352650 9103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ca8d54012fb4deb9dfa36efcee49d79. Latest consensus state: current_term: 1 leader_uuid: "4ca8d54012fb4deb9dfa36efcee49d79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca8d54012fb4deb9dfa36efcee49d79" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } } }
I20260807 07:00:37.358044 9103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:37.364814 9108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:37.366005 9087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:37.345237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:32795 (local address 127.0.0.1:41431)
0807 07:00:37.345482 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:37.345488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:37.345927 (+ 439us) server_negotiation.cc:407] Connection header received
0807 07:00:37.346068 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:37.346071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:37.346171 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:37.346299 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:37.348377 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:37.349861 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:37.352140 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:37.352916 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:37.353092 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:37.357113 (+ 4021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:37.357122 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:37.357128 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:37.357188 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:37.361540 (+ 4352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:37.362509 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:37.362518 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:37.362522 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:37.362672 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:37.363300 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:37.363307 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:37.363313 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:37.363790 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:37.364053 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:37.365411 (+ 1358us) server_negotiation.cc:299] Negotiation successful
0807 07:00:37.365598 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 07:00:37.379741 9108 catalog_manager.cc:1347] Generated new cluster ID: cc5b04d22fcb4dff9f028de8e678b5dd
I20260807 07:00:37.379860 9108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:37.408989 9108 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:37.410296 9108 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:37.422003 9108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ca8d54012fb4deb9dfa36efcee49d79: Generated new TSK 0
I20260807 07:00:37.422776 9108 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:37.431178 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 8975
I20260807 07:00:37.432267 9073 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:37.523874 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 8975
W20260807 07:00:37.552690 8951 connection.cc:535] client connection to 127.0.0.1:41431 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41431): Connection reset by peer (error 104)
2026-08-07T07:00:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2263 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:37 dist-test-slave-tfpf krb5kdc[9135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:37 dist-test-slave-tfpf krb5kdc[9135](info): set up 2 sockets
Aug 07 07:00:37 dist-test-slave-tfpf krb5kdc[9135](info): commencing operation
krb5kdc: starting...
W20260807 07:00:38.824559 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.007s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:39 dist-test-slave-tfpf krb5kdc[9135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086039, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:39.138049 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43729
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43729
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:39.476867 9154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:39.477240 9154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:39.477434 9154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:39.483940 9154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:39.484028 9154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:39.484067 9154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:39.484138 9154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:39.484196 9154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:39.492692 9154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43729
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:39.493875 9154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:39.495097 9154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:39.506367 9164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:39.506445 9165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:39.506413 9167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:39.507582 9154 server_base.cc:1034] running on GCE node
I20260807 07:00:39.508296 9154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:39.509821 9154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:39.511044 9154 hybrid_clock.cc:648] HybridClock initialized: now 1786086039510996 us; error 34 us; skew 500 ppm
I20260807 07:00:39.511411 9154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:39 dist-test-slave-tfpf krb5kdc[9135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086039, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:39.514763 9154 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:39.516338 9154 webserver.cc:460] Webserver started at http://127.0.0.1:43255/ using document root <none> and password file <none>
I20260807 07:00:39.517123 9154 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:39.517297 9154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:39.517642 9154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:39.520744 9154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa"
format_stamp: "Formatted at 2026-08-07 07:00:39 on dist-test-slave-tfpf"
server_key: "5c62c9603c573d0fcef56b9aa3f320ef"
server_key_iv: "89b9a6fe91212f7d2812a6dc9e9548ef"
server_key_version: "encryptionkey@0"
I20260807 07:00:39.521596 9154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa"
format_stamp: "Formatted at 2026-08-07 07:00:39 on dist-test-slave-tfpf"
server_key: "5c62c9603c573d0fcef56b9aa3f320ef"
server_key_iv: "89b9a6fe91212f7d2812a6dc9e9548ef"
server_key_version: "encryptionkey@0"
I20260807 07:00:39.526870 9154 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260807 07:00:39.530323 9179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:39.531512 9154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 07:00:39.531702 9154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa"
format_stamp: "Formatted at 2026-08-07 07:00:39 on dist-test-slave-tfpf"
server_key: "5c62c9603c573d0fcef56b9aa3f320ef"
server_key_iv: "89b9a6fe91212f7d2812a6dc9e9548ef"
server_key_version: "encryptionkey@0"
I20260807 07:00:39.531886 9154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:39.563643 9154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:39.567356 9154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:39.567639 9154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:39.586266 9154 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43729
I20260807 07:00:39.586303 9266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43729 every 8 connection(s)
I20260807 07:00:39.587502 9154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:39.589380 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 9154
I20260807 07:00:39.589591 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:39.590179 11006 external_mini_cluster.cc:1428] Setting key 7648e34a167d1725e4df41b089d90ac5
I20260807 07:00:39.591964 9269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:39.603039 9272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:39.591933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:38137 (local address 127.0.0.1:43729)
0807 07:00:39.592718 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:39.592728 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:39.592765 (+ 37us) server_negotiation.cc:407] Connection header received
0807 07:00:39.594232 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:39.594252 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:39.594595 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:39.594886 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:39.595432 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:39.596835 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:39.598638 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:39.599196 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:39.599364 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:39.600699 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:39.600717 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:39.600727 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:39.601360 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:39.601435 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:39.601459 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:39.601599 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:39.601916 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 07:00:39.602104 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":340,"threads_started":1}
I20260807 07:00:39.604278 9269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa: Bootstrap starting.
I20260807 07:00:39.606501 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:39.607280 9269 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:39.608187 9269 log.cc:824] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:39.611402 9269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa: No bootstrap required, opened a new log
I20260807 07:00:39.616884 9272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:39.610968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:37931 (local address 127.0.0.1:43729)
0807 07:00:39.611164 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:39.611172 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:39.611544 (+ 372us) server_negotiation.cc:407] Connection header received
0807 07:00:39.611732 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:39.611737 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:39.611810 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:39.611927 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:39.612431 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:39.613244 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:39.614506 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:39.614928 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:39.615088 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:39.616143 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:39.616148 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:39.616150 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:39.616165 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:39.616215 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:39.616231 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:39.616356 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:39.616557 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 07:00:39.616607 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 07:00:39.619125 9269 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43729 } }
I20260807 07:00:39.619503 9269 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:39.619623 9269 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5cd73a4d52e4b55a2a6c66dfa0578aa, State: Initialized, Role: FOLLOWER
I20260807 07:00:39.620177 9269 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43729 } }
I20260807 07:00:39.620388 9269 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:39.620497 9269 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:39.620671 9269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:39.622771 9269 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43729 } }
I20260807 07:00:39.623332 9269 leader_election.cc:302] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5cd73a4d52e4b55a2a6c66dfa0578aa; no voters:
I20260807 07:00:39.623886 9269 leader_election.cc:288] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:39.624023 9279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:39.624717 9279 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [term 1 LEADER]: Becoming Leader. State: Replica: a5cd73a4d52e4b55a2a6c66dfa0578aa, State: Running, Role: LEADER
I20260807 07:00:39.625283 9279 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43729 } }
I20260807 07:00:39.625965 9269 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:39.628686 9281 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5cd73a4d52e4b55a2a6c66dfa0578aa. Latest consensus state: current_term: 1 leader_uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43729 } } }
I20260807 07:00:39.632053 9280 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5cd73a4d52e4b55a2a6c66dfa0578aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43729 } } }
I20260807 07:00:39.632501 9281 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:39.632957 9280 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:39.633682 9292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:39.640304 9292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:39.649667 9292 catalog_manager.cc:1347] Generated new cluster ID: b0c182ca95ec42578ac90e19610ea4ab
I20260807 07:00:39.649775 9292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:39.663774 9292 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:39.665544 9292 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:39.677754 9292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5cd73a4d52e4b55a2a6c66dfa0578aa: Generated new TSK 0
I20260807 07:00:39.678650 9292 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:39.688253 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 9154
W20260807 07:00:39.689399 9261 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.74:38137
W20260807 07:00:39.690166 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 9154: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:39.690312 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 9154
W20260807 07:00:39.718236 9133 connection.cc:535] client connection to 127.0.0.1:43729 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43729): Connection reset by peer (error 104)
2026-08-07T07:00:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2165 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:39 dist-test-slave-tfpf krb5kdc[9313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:39 dist-test-slave-tfpf krb5kdc[9313](info): set up 2 sockets
Aug 07 07:00:39 dist-test-slave-tfpf krb5kdc[9313](info): commencing operation
krb5kdc: starting...
W20260807 07:00:40.962635 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:41 dist-test-slave-tfpf krb5kdc[9313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:41.260648 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36769
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:41.606029 9335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:41.606289 9335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:41.606377 9335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:41.613418 9335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:41.613531 9335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:41.613585 9335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:41.613646 9335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:41.613689 9335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:41.623575 9335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:41.624730 9335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:41.626040 9335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:41.638079 9341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:41.638078 9342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:41.638281 9345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:41.638942 9335 server_base.cc:1034] running on GCE node
I20260807 07:00:41.639707 9335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:41.640980 9335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:41.642225 9335 hybrid_clock.cc:648] HybridClock initialized: now 1786086041642174 us; error 47 us; skew 500 ppm
I20260807 07:00:41.642524 9335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:41 dist-test-slave-tfpf krb5kdc[9313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086041, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:41.645478 9335 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:41.646754 9335 webserver.cc:460] Webserver started at http://127.0.0.1:46499/ using document root <none> and password file <none>
I20260807 07:00:41.647374 9335 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:41.647532 9335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:41.647825 9335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:41.650688 9335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "bb4a82ef1b2b455d8c82d353fb63ed33"
format_stamp: "Formatted at 2026-08-07 07:00:41 on dist-test-slave-tfpf"
server_key: "b12e5b8c315377576306d40493876007"
server_key_iv: "8bbb609585a8e0ccb2540774dd3c25d6"
server_key_version: "encryptionkey@0"
I20260807 07:00:41.651433 9335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "bb4a82ef1b2b455d8c82d353fb63ed33"
format_stamp: "Formatted at 2026-08-07 07:00:41 on dist-test-slave-tfpf"
server_key: "b12e5b8c315377576306d40493876007"
server_key_iv: "8bbb609585a8e0ccb2540774dd3c25d6"
server_key_version: "encryptionkey@0"
I20260807 07:00:41.656888 9335 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 07:00:41.660367 9357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:41.661710 9335 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 07:00:41.661931 9335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "bb4a82ef1b2b455d8c82d353fb63ed33"
format_stamp: "Formatted at 2026-08-07 07:00:41 on dist-test-slave-tfpf"
server_key: "b12e5b8c315377576306d40493876007"
server_key_iv: "8bbb609585a8e0ccb2540774dd3c25d6"
server_key_version: "encryptionkey@0"
I20260807 07:00:41.662143 9335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:41.667698 9335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:41.671954 9335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:41.672273 9335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:41.690610 9335 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36769
I20260807 07:00:41.690686 9434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36769 every 8 connection(s)
I20260807 07:00:41.691923 9335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:41.695894 9436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:41.700198 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 9335
I20260807 07:00:41.700413 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:41.700879 11006 external_mini_cluster.cc:1428] Setting key 9b0471a61b795d7d492cfe2eb9ad4a2d
I20260807 07:00:41.707216 9436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33: Bootstrap starting.
I20260807 07:00:41.708739 9439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:41.702659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:47221 (local address 127.0.0.1:36769)
0807 07:00:41.703438 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:41.703449 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:41.703488 (+ 39us) server_negotiation.cc:407] Connection header received
0807 07:00:41.705678 (+ 2190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:41.705699 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:41.705986 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:41.706286 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:41.707262 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:41.707267 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:41.707278 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:41.707290 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:41.707370 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:41.707408 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:41.707556 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:41.707688 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 07:00:41.707857 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":360,"threads_started":1}
I20260807 07:00:41.710796 9436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:41.712026 9436 log.cc:824] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:41.712270 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:41.714609 9436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33: No bootstrap required, opened a new log
I20260807 07:00:41.719092 9439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:41.716810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:36703 (local address 127.0.0.1:36769)
0807 07:00:41.717018 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:41.717023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:41.717395 (+ 372us) server_negotiation.cc:407] Connection header received
0807 07:00:41.717540 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:41.717543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:41.717592 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:41.717672 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:41.718528 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:41.718531 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:41.718534 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:41.718545 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:41.718576 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:41.718588 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:41.718660 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:41.718784 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 07:00:41.718821 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 07:00:41.722822 9436 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb4a82ef1b2b455d8c82d353fb63ed33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36769 } }
I20260807 07:00:41.723214 9436 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:41.723320 9436 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4a82ef1b2b455d8c82d353fb63ed33, State: Initialized, Role: FOLLOWER
I20260807 07:00:41.723861 9436 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb4a82ef1b2b455d8c82d353fb63ed33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36769 } }
I20260807 07:00:41.724165 9436 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:41.724362 9436 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:41.724588 9436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:41.726773 9436 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb4a82ef1b2b455d8c82d353fb63ed33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36769 } }
I20260807 07:00:41.727195 9436 leader_election.cc:302] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb4a82ef1b2b455d8c82d353fb63ed33; no voters:
I20260807 07:00:41.727737 9436 leader_election.cc:288] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:41.727890 9450 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:41.728552 9450 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [term 1 LEADER]: Becoming Leader. State: Replica: bb4a82ef1b2b455d8c82d353fb63ed33, State: Running, Role: LEADER
I20260807 07:00:41.729190 9450 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb4a82ef1b2b455d8c82d353fb63ed33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36769 } }
I20260807 07:00:41.730002 9436 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:41.732285 9454 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb4a82ef1b2b455d8c82d353fb63ed33. Latest consensus state: current_term: 1 leader_uuid: "bb4a82ef1b2b455d8c82d353fb63ed33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb4a82ef1b2b455d8c82d353fb63ed33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36769 } } }
I20260807 07:00:41.732463 9452 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb4a82ef1b2b455d8c82d353fb63ed33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb4a82ef1b2b455d8c82d353fb63ed33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36769 } } }
I20260807 07:00:41.732765 9454 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:41.732816 9452 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:41.738919 9464 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:41.744351 9464 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:41.753449 9464 catalog_manager.cc:1347] Generated new cluster ID: d8a2c1ef1a26461689b9aaf4894bf5f8
I20260807 07:00:41.753568 9464 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:41.769389 9464 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:41.769838 9464 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:41.784549 9464 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb4a82ef1b2b455d8c82d353fb63ed33: Generated new TSK 0
I20260807 07:00:41.785545 9464 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:41.802587 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 9335
W20260807 07:00:41.803779 9426 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.74:47221
W20260807 07:00:41.804563 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 9335: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:41.804754 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 9335
2026-08-07T07:00:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2111 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:41 dist-test-slave-tfpf krb5kdc[9487](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:41 dist-test-slave-tfpf krb5kdc[9487](info): set up 2 sockets
Aug 07 07:00:41 dist-test-slave-tfpf krb5kdc[9487](info): commencing operation
krb5kdc: starting...
W20260807 07:00:43.083096 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:43 dist-test-slave-tfpf krb5kdc[9487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:43.386022 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43647
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:43.722251 9511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:43.722525 9511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:43.722692 9511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:43.729568 9511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:43.729728 9511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:43.729839 9511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:43.729944 9511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:43.730033 9511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:43.739058 9511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43647
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:43.740357 9511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:43.741951 9511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:43.753129 9518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:43.753252 9521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:43.753305 9519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:43.754202 9511 server_base.cc:1034] running on GCE node
I20260807 07:00:43.754961 9511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:43.756206 9511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:43.757457 9511 hybrid_clock.cc:648] HybridClock initialized: now 1786086043757386 us; error 42 us; skew 500 ppm
I20260807 07:00:43.757864 9511 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:43 dist-test-slave-tfpf krb5kdc[9487](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086043, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:43.765861 9511 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:43.767234 9511 webserver.cc:460] Webserver started at http://127.0.0.1:41595/ using document root <none> and password file <none>
I20260807 07:00:43.767850 9511 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:43.767947 9511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:43.768187 9511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:43.771158 9511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "e5885896147947dfa673bfaae80c5fc6"
format_stamp: "Formatted at 2026-08-07 07:00:43 on dist-test-slave-tfpf"
server_key: "e82292f42ecf5414bf8ed154c11dfae2"
server_key_iv: "d4519119f2a7a7882818745d1d0ae431"
server_key_version: "encryptionkey@0"
I20260807 07:00:43.771859 9511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "e5885896147947dfa673bfaae80c5fc6"
format_stamp: "Formatted at 2026-08-07 07:00:43 on dist-test-slave-tfpf"
server_key: "e82292f42ecf5414bf8ed154c11dfae2"
server_key_iv: "d4519119f2a7a7882818745d1d0ae431"
server_key_version: "encryptionkey@0"
I20260807 07:00:43.776779 9511 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260807 07:00:43.780194 9530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:43.781495 9511 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 07:00:43.781641 9511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "e5885896147947dfa673bfaae80c5fc6"
format_stamp: "Formatted at 2026-08-07 07:00:43 on dist-test-slave-tfpf"
server_key: "e82292f42ecf5414bf8ed154c11dfae2"
server_key_iv: "d4519119f2a7a7882818745d1d0ae431"
server_key_version: "encryptionkey@0"
I20260807 07:00:43.781805 9511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:43.803117 9511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:43.807089 9511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:43.807325 9511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:43.826876 9511 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43647
I20260807 07:00:43.826900 9610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43647 every 8 connection(s)
I20260807 07:00:43.828649 9511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:43.831207 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 9511
I20260807 07:00:43.831403 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:43.831900 11006 external_mini_cluster.cc:1428] Setting key c208b8de04e57e3e95a4fb7eeb37d0c8
I20260807 07:00:43.832731 9611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 07:00:43 dist-test-slave-tfpf krb5kdc[9487](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 07:00:43.847498 9611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6: Bootstrap starting.
I20260807 07:00:43.851981 9611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:43.853273 9611 log.cc:824] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:43.856700 9611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6: No bootstrap required, opened a new log
I20260807 07:00:43.857134 9615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:43.833904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:43097 (local address 127.0.0.1:43647)
0807 07:00:43.834705 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:43.834720 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:43.834774 (+ 54us) server_negotiation.cc:407] Connection header received
0807 07:00:43.836791 (+ 2017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:43.836820 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:43.837398 (+ 578us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:43.837841 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:43.839208 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:43.841350 (+ 2142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:43.842547 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:43.843597 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:43.843804 (+ 207us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:43.848297 (+ 4493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:43.848307 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:43.848326 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:43.848386 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:43.852507 (+ 4121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:43.853348 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:43.853356 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:43.853366 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:43.853570 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:43.854129 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:43.854132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:43.854134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:43.854673 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:43.855025 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:43.855464 (+ 439us) server_negotiation.cc:299] Negotiation successful
0807 07:00:43.855814 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":327,"threads_started":1}
I20260807 07:00:43.861099 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:43.865223 9611 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5885896147947dfa673bfaae80c5fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43647 } }
I20260807 07:00:43.865681 9611 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:43.865828 9611 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5885896147947dfa673bfaae80c5fc6, State: Initialized, Role: FOLLOWER
I20260807 07:00:43.866495 9611 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5885896147947dfa673bfaae80c5fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43647 } }
I20260807 07:00:43.866703 9611 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:43.866909 9611 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:43.867093 9611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:43.869735 9611 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5885896147947dfa673bfaae80c5fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43647 } }
I20260807 07:00:43.870213 9611 leader_election.cc:302] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5885896147947dfa673bfaae80c5fc6; no voters:
I20260807 07:00:43.870867 9611 leader_election.cc:288] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:43.870975 9629 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:43.871726 9629 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [term 1 LEADER]: Becoming Leader. State: Replica: e5885896147947dfa673bfaae80c5fc6, State: Running, Role: LEADER
I20260807 07:00:43.872344 9629 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5885896147947dfa673bfaae80c5fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43647 } }
I20260807 07:00:43.875329 9631 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5885896147947dfa673bfaae80c5fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5885896147947dfa673bfaae80c5fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43647 } } }
I20260807 07:00:43.875788 9631 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:43.875566 9630 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5885896147947dfa673bfaae80c5fc6. Latest consensus state: current_term: 1 leader_uuid: "e5885896147947dfa673bfaae80c5fc6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5885896147947dfa673bfaae80c5fc6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43647 } } }
I20260807 07:00:43.876021 9630 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:43.875334 9611 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:43.880577 9634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:43.883693 9615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:43.865208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:43687 (local address 127.0.0.1:43647)
0807 07:00:43.865349 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:43.865352 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:43.865944 (+ 592us) server_negotiation.cc:407] Connection header received
0807 07:00:43.866144 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:43.866149 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:43.866227 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:43.866333 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:43.867962 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:43.869007 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:43.870366 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:43.871111 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:43.871263 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:43.874647 (+ 3384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:43.874654 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:43.874658 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:43.874698 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:43.879142 (+ 4444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:43.880321 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:43.880326 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:43.880329 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:43.880560 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:43.881234 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:43.881239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:43.881242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:43.881664 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:43.881983 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:43.883143 (+ 1160us) server_negotiation.cc:299] Negotiation successful
0807 07:00:43.883322 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 07:00:43.886920 9634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:43.896445 9634 catalog_manager.cc:1347] Generated new cluster ID: 150248b3e6d442d5b4b8108d01ba04e1
I20260807 07:00:43.896562 9634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:43.912101 9634 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:43.913355 9634 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:43.923985 9634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5885896147947dfa673bfaae80c5fc6: Generated new TSK 0
I20260807 07:00:43.924803 9634 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:43.931391 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 9511
I20260807 07:00:43.932469 9604 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:44.023279 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 9511
W20260807 07:00:44.045759 9481 connection.cc:535] client connection to 127.0.0.1:43647 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43647): Connection reset by peer (error 104)
2026-08-07T07:00:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2220 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:44 dist-test-slave-tfpf krb5kdc[9664](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:44 dist-test-slave-tfpf krb5kdc[9664](info): set up 2 sockets
Aug 07 07:00:44 dist-test-slave-tfpf krb5kdc[9664](info): commencing operation
krb5kdc: starting...
W20260807 07:00:45.302291 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.002s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:45 dist-test-slave-tfpf krb5kdc[9664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:45.606262 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45577
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45577
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:45.944204 9681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:45.944468 9681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:45.944550 9681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:45.951481 9681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:45.951606 9681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:45.951701 9681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:45.951815 9681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:45.951891 9681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:45.961434 9681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45577
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:45.962603 9681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:45.963877 9681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:45.976274 9688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:45.976366 9690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:45.976641 9693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:45.977582 9681 server_base.cc:1034] running on GCE node
I20260807 07:00:45.978343 9681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:45.979696 9681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:45.980924 9681 hybrid_clock.cc:648] HybridClock initialized: now 1786086045980888 us; error 49 us; skew 500 ppm
I20260807 07:00:45.981303 9681 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:45 dist-test-slave-tfpf krb5kdc[9664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086045, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:45.984067 9681 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:45.985450 9681 webserver.cc:460] Webserver started at http://127.0.0.1:34835/ using document root <none> and password file <none>
I20260807 07:00:45.986095 9681 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:45.986243 9681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:45.986564 9681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:45.989665 9681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "70f8a2918e9b4a68aa0925f56c027e6b"
format_stamp: "Formatted at 2026-08-07 07:00:45 on dist-test-slave-tfpf"
server_key: "f063f3932ad1ed0fa45a4aec2c80f743"
server_key_iv: "2e478577a868c33f8ec5baf0a2d2b5d1"
server_key_version: "encryptionkey@0"
I20260807 07:00:45.990474 9681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "70f8a2918e9b4a68aa0925f56c027e6b"
format_stamp: "Formatted at 2026-08-07 07:00:45 on dist-test-slave-tfpf"
server_key: "f063f3932ad1ed0fa45a4aec2c80f743"
server_key_iv: "2e478577a868c33f8ec5baf0a2d2b5d1"
server_key_version: "encryptionkey@0"
I20260807 07:00:45.995527 9681 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 07:00:45.998735 9702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:45.999986 9681 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 07:00:46.000176 9681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "70f8a2918e9b4a68aa0925f56c027e6b"
format_stamp: "Formatted at 2026-08-07 07:00:45 on dist-test-slave-tfpf"
server_key: "f063f3932ad1ed0fa45a4aec2c80f743"
server_key_iv: "2e478577a868c33f8ec5baf0a2d2b5d1"
server_key_version: "encryptionkey@0"
I20260807 07:00:46.000365 9681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:46.020985 9681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:46.025440 9681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:46.025743 9681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:46.044590 9681 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45577
I20260807 07:00:46.044642 9784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45577 every 8 connection(s)
I20260807 07:00:46.045931 9681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:46.047000 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 9681
I20260807 07:00:46.047206 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:46.047775 11006 external_mini_cluster.cc:1428] Setting key da49d9b900fbc7258e7060c606aadd69
I20260807 07:00:46.050551 9785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:46.061220 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:46.049648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:57707 (local address 127.0.0.1:45577)
0807 07:00:46.050443 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:46.050454 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:46.050495 (+ 41us) server_negotiation.cc:407] Connection header received
0807 07:00:46.052201 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:46.052222 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:46.052579 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:46.052907 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:46.053540 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:46.054871 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:46.056741 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:46.057439 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:46.057574 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:46.058886 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:46.058892 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:46.058904 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:46.059417 (+ 513us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:46.059493 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:46.059525 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:46.059652 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:46.060001 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 07:00:46.060198 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":390,"threads_started":1}
I20260807 07:00:46.062956 9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b: Bootstrap starting.
I20260807 07:00:46.065568 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:46.066465 9785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:46.067695 9785 log.cc:824] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:46.070991 9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b: No bootstrap required, opened a new log
I20260807 07:00:46.077447 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:46.070899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:52057 (local address 127.0.0.1:45577)
0807 07:00:46.071114 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:46.071120 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:46.071498 (+ 378us) server_negotiation.cc:407] Connection header received
0807 07:00:46.071633 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:46.071637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:46.071714 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:46.071824 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:46.072310 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:46.073535 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:46.074754 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:46.075438 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:46.075575 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:46.076597 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:46.076603 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:46.076607 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:46.076626 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:46.076689 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:46.076709 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:46.076854 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:46.077012 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 07:00:46.077118 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 07:00:46.079658 9785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f8a2918e9b4a68aa0925f56c027e6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45577 } }
I20260807 07:00:46.080026 9785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:46.080137 9785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70f8a2918e9b4a68aa0925f56c027e6b, State: Initialized, Role: FOLLOWER
I20260807 07:00:46.080773 9785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f8a2918e9b4a68aa0925f56c027e6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45577 } }
I20260807 07:00:46.081037 9785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:46.081244 9785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:46.081436 9785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:46.083353 9785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f8a2918e9b4a68aa0925f56c027e6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45577 } }
I20260807 07:00:46.083801 9785 leader_election.cc:302] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70f8a2918e9b4a68aa0925f56c027e6b; no voters:
I20260807 07:00:46.084312 9785 leader_election.cc:288] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:46.084431 9803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:46.085171 9803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [term 1 LEADER]: Becoming Leader. State: Replica: 70f8a2918e9b4a68aa0925f56c027e6b, State: Running, Role: LEADER
I20260807 07:00:46.085736 9803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f8a2918e9b4a68aa0925f56c027e6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45577 } }
I20260807 07:00:46.086298 9785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:46.088253 9805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70f8a2918e9b4a68aa0925f56c027e6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f8a2918e9b4a68aa0925f56c027e6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45577 } } }
I20260807 07:00:46.088614 9805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:46.089998 9806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70f8a2918e9b4a68aa0925f56c027e6b. Latest consensus state: current_term: 1 leader_uuid: "70f8a2918e9b4a68aa0925f56c027e6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f8a2918e9b4a68aa0925f56c027e6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45577 } } }
I20260807 07:00:46.090739 9806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:46.091581 9813 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:46.100687 9813 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:46.109654 9813 catalog_manager.cc:1347] Generated new cluster ID: dde937dfa9d44d1aa3dfb7fc575992ef
I20260807 07:00:46.109781 9813 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:46.142599 9813 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:46.143977 9813 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:46.151151 9813 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70f8a2918e9b4a68aa0925f56c027e6b: Generated new TSK 0
I20260807 07:00:46.151950 9813 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:46.159621 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 9681
W20260807 07:00:46.160709 9780 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.74:57707
W20260807 07:00:46.161455 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 9681: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:46.161594 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 9681
W20260807 07:00:46.191669 9662 connection.cc:535] client connection to 127.0.0.1:45577 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45577): Connection reset by peer (error 104)
2026-08-07T07:00:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2141 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:46 dist-test-slave-tfpf krb5kdc[9833](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:46 dist-test-slave-tfpf krb5kdc[9833](info): set up 2 sockets
Aug 07 07:00:46 dist-test-slave-tfpf krb5kdc[9833](info): commencing operation
krb5kdc: starting...
W20260807 07:00:47.461472 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:47 dist-test-slave-tfpf krb5kdc[9833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 07:00:47.777869 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33697
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:48.122617 9849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:48.122895 9849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:48.123082 9849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:48.130488 9849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:48.130611 9849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:48.130697 9849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:48.130808 9849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:48.130873 9849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:48.140295 9849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33697
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:48.141568 9849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:48.142825 9849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:48.154722 9858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:48.154757 9860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:48.154816 9857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:48.155633 9849 server_base.cc:1034] running on GCE node
I20260807 07:00:48.156435 9849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:48.157943 9849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:48.159176 9849 hybrid_clock.cc:648] HybridClock initialized: now 1786086048159125 us; error 42 us; skew 500 ppm
I20260807 07:00:48.159561 9849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:48 dist-test-slave-tfpf krb5kdc[9833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086048, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:48.162708 9849 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 07:00:48.164110 9849 webserver.cc:460] Webserver started at http://127.0.0.1:44279/ using document root <none> and password file <none>
I20260807 07:00:48.164791 9849 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:48.164963 9849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:48.165318 9849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:48.168207 9849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214"
format_stamp: "Formatted at 2026-08-07 07:00:48 on dist-test-slave-tfpf"
server_key: "2154da20bd05524278be2cb9ca51dbb2"
server_key_iv: "05ca7693d64d718174da153484760dba"
server_key_version: "encryptionkey@0"
I20260807 07:00:48.168975 9849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214"
format_stamp: "Formatted at 2026-08-07 07:00:48 on dist-test-slave-tfpf"
server_key: "2154da20bd05524278be2cb9ca51dbb2"
server_key_iv: "05ca7693d64d718174da153484760dba"
server_key_version: "encryptionkey@0"
I20260807 07:00:48.174150 9849 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260807 07:00:48.177471 9871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:48.178717 9849 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 07:00:48.178933 9849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214"
format_stamp: "Formatted at 2026-08-07 07:00:48 on dist-test-slave-tfpf"
server_key: "2154da20bd05524278be2cb9ca51dbb2"
server_key_iv: "05ca7693d64d718174da153484760dba"
server_key_version: "encryptionkey@0"
I20260807 07:00:48.179134 9849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:48.184814 9849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:48.188633 9849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:48.188937 9849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:48.208076 9849 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33697
I20260807 07:00:48.208122 9939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33697 every 8 connection(s)
I20260807 07:00:48.209599 9849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:48.210232 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 9849
I20260807 07:00:48.210445 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:48.211076 11006 external_mini_cluster.cc:1428] Setting key 0b7ef00a972f786852940693e07bf198
I20260807 07:00:48.214148 9941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:48.218940 9947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:48.212912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:49627 (local address 127.0.0.1:33697)
0807 07:00:48.213716 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:48.213727 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:48.213767 (+ 40us) server_negotiation.cc:407] Connection header received
0807 07:00:48.215587 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:48.215608 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:48.215909 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:48.216277 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:48.217384 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:48.217390 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:48.217402 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:48.217416 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:48.217483 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:48.217501 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:48.217741 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:48.217890 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 07:00:48.218077 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":369,"threads_started":1}
I20260807 07:00:48.222666 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:48.225945 9941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214: Bootstrap starting.
I20260807 07:00:48.229328 9941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:48.229669 9947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:48.227206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.74:44693 (local address 127.0.0.1:33697)
0807 07:00:48.227402 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:48.227409 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:48.227700 (+ 291us) server_negotiation.cc:407] Connection header received
0807 07:00:48.227892 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:48.227899 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:48.227949 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:48.228049 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:48.228976 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:48.228982 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:48.228986 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:48.229008 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:48.229045 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:48.229099 (+ 54us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:48.229206 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:48.229320 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 07:00:48.229396 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 07:00:48.230603 9941 log.cc:824] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:48.233251 9941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214: No bootstrap required, opened a new log
I20260807 07:00:48.240694 9941 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260807 07:00:48.241293 9941 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:48.241428 9941 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19ba1d6d4d3c494ca90d7cd7e3fb0214, State: Initialized, Role: FOLLOWER
I20260807 07:00:48.242064 9941 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260807 07:00:48.242290 9941 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:48.242450 9941 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:48.242633 9941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:48.245004 9941 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260807 07:00:48.245525 9941 leader_election.cc:302] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19ba1d6d4d3c494ca90d7cd7e3fb0214; no voters:
I20260807 07:00:48.246105 9941 leader_election.cc:288] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:48.246234 9961 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:48.246939 9961 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [term 1 LEADER]: Becoming Leader. State: Replica: 19ba1d6d4d3c494ca90d7cd7e3fb0214, State: Running, Role: LEADER
I20260807 07:00:48.247397 9961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } }
I20260807 07:00:48.248185 9941 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:48.250551 9962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } } }
I20260807 07:00:48.251060 9962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:48.252138 9963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19ba1d6d4d3c494ca90d7cd7e3fb0214. Latest consensus state: current_term: 1 leader_uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19ba1d6d4d3c494ca90d7cd7e3fb0214" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33697 } } }
I20260807 07:00:48.252581 9963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:48.254068 9972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:48.259277 9972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:48.267180 9972 catalog_manager.cc:1347] Generated new cluster ID: 9af332868add40408e2ce9c3c8169adf
I20260807 07:00:48.267282 9972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:48.276995 9972 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:48.277474 9972 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:48.299119 9972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19ba1d6d4d3c494ca90d7cd7e3fb0214: Generated new TSK 0
I20260807 07:00:48.300248 9972 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:48.309039 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 9849
W20260807 07:00:48.310453 9931 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.74:49627
W20260807 07:00:48.311219 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 9849: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:48.311365 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 9849
2026-08-07T07:00:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2147 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:48 dist-test-slave-tfpf krb5kdc[9993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:48 dist-test-slave-tfpf krb5kdc[9993](info): set up 2 sockets
Aug 07 07:00:48 dist-test-slave-tfpf krb5kdc[9993](info): commencing operation
krb5kdc: starting...
W20260807 07:00:49.622723 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.001s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:49 dist-test-slave-tfpf krb5kdc[9993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:00:49.940074 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:46457
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:33949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:46457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:50.302445 10010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:50.302753 10010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:50.302845 10010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:50.310140 10010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:50.310286 10010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:50.310336 10010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:50.310400 10010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:50.310438 10010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:50.321202 10010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:33949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:46457
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:46457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:50.323088 10010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:50.324916 10010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:50.336691 10019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:50.336771 10020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:50.336658 10023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:50.337909 10010 server_base.cc:1034] running on GCE node
I20260807 07:00:50.338624 10010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:50.340027 10010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:50.341229 10010 hybrid_clock.cc:648] HybridClock initialized: now 1786086050341186 us; error 34 us; skew 500 ppm
I20260807 07:00:50.341588 10010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:50 dist-test-slave-tfpf krb5kdc[9993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086050, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:50.344906 10010 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:00:50.346387 10010 webserver.cc:460] Webserver started at http://127.10.191.190:33055/ using document root <none> and password file <none>
I20260807 07:00:50.347091 10010 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:50.347249 10010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:50.347575 10010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:50.350812 10010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "772c0f081b0748f0a02dbf70c7e31ba6"
format_stamp: "Formatted at 2026-08-07 07:00:50 on dist-test-slave-tfpf"
server_key: "b5fdc131c885930a722cb05b3ba7ca21"
server_key_iv: "0616da7161afb36e79ce2124b7e28aba"
server_key_version: "encryptionkey@0"
I20260807 07:00:50.351619 10010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "772c0f081b0748f0a02dbf70c7e31ba6"
format_stamp: "Formatted at 2026-08-07 07:00:50 on dist-test-slave-tfpf"
server_key: "b5fdc131c885930a722cb05b3ba7ca21"
server_key_iv: "0616da7161afb36e79ce2124b7e28aba"
server_key_version: "encryptionkey@0"
I20260807 07:00:50.357013 10010 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260807 07:00:50.360450 10034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:50.361804 10010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 07:00:50.362002 10010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "772c0f081b0748f0a02dbf70c7e31ba6"
format_stamp: "Formatted at 2026-08-07 07:00:50 on dist-test-slave-tfpf"
server_key: "b5fdc131c885930a722cb05b3ba7ca21"
server_key_iv: "0616da7161afb36e79ce2124b7e28aba"
server_key_version: "encryptionkey@0"
I20260807 07:00:50.362218 10010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:50.397588 10010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:50.402207 10010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:50.402527 10010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:50.421555 10010 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:46457
I20260807 07:00:50.421581 10110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:46457 every 8 connection(s)
I20260807 07:00:50.422906 10010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:50.426759 10112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:50.432942 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 10010
I20260807 07:00:50.433177 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:50.433751 11006 external_mini_cluster.cc:1428] Setting key 9fd7eb1be2afb92058069a71118de00b
I20260807 07:00:50.438064 10112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6: Bootstrap starting.
I20260807 07:00:50.442086 10112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:50.443359 10112 log.cc:824] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:50.446398 10112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6: No bootstrap required, opened a new log
Aug 07 07:00:50 dist-test-slave-tfpf krb5kdc[9993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:50.455777 10112 raft_consensus.cc:348] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "772c0f081b0748f0a02dbf70c7e31ba6" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46457 } }
I20260807 07:00:50.456277 10112 raft_consensus.cc:374] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:50.456391 10112 raft_consensus.cc:729] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772c0f081b0748f0a02dbf70c7e31ba6, State: Initialized, Role: FOLLOWER
I20260807 07:00:50.457144 10112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "772c0f081b0748f0a02dbf70c7e31ba6" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46457 } }
I20260807 07:00:50.457442 10112 raft_consensus.cc:388] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:50.457610 10112 raft_consensus.cc:482] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:50.457818 10112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:50.460217 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:50.435990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51471 (local address 127.10.191.190:46457)
0807 07:00:50.437025 (+ 1035us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:50.437041 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:50.437464 (+ 423us) server_negotiation.cc:407] Connection header received
0807 07:00:50.440046 (+ 2582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:50.440086 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:50.440614 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:50.441029 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:50.442584 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:50.444342 (+ 1758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:50.445666 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:50.446707 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:50.446903 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:50.450992 (+ 4089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:50.451003 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:50.451027 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:50.451090 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:50.455203 (+ 4113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:50.455956 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:50.455963 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:50.455970 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:50.456187 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:50.456840 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:50.456845 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:50.456848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:50.457629 (+ 781us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:50.457998 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:50.458493 (+ 495us) server_negotiation.cc:299] Negotiation successful
0807 07:00:50.458856 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":437,"threads_started":1}
I20260807 07:00:50.461120 10112 raft_consensus.cc:504] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "772c0f081b0748f0a02dbf70c7e31ba6" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46457 } }
I20260807 07:00:50.461659 10112 leader_election.cc:302] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 772c0f081b0748f0a02dbf70c7e31ba6; no voters:
I20260807 07:00:50.462288 10112 leader_election.cc:288] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:50.462430 10118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:50.463690 10118 raft_consensus.cc:686] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [term 1 LEADER]: Becoming Leader. State: Replica: 772c0f081b0748f0a02dbf70c7e31ba6, State: Running, Role: LEADER
I20260807 07:00:50.464339 10118 consensus_queue.cc:237] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "772c0f081b0748f0a02dbf70c7e31ba6" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46457 } }
I20260807 07:00:50.464488 10112 sys_catalog.cc:564] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:50.464967 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:50.467300 10120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "772c0f081b0748f0a02dbf70c7e31ba6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "772c0f081b0748f0a02dbf70c7e31ba6" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46457 } } }
I20260807 07:00:50.467701 10120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:50.468325 10121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 772c0f081b0748f0a02dbf70c7e31ba6. Latest consensus state: current_term: 1 leader_uuid: "772c0f081b0748f0a02dbf70c7e31ba6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "772c0f081b0748f0a02dbf70c7e31ba6" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 46457 } } }
I20260807 07:00:50.468619 10121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:50.470762 10130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:50.476387 10130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:50.490355 10130 catalog_manager.cc:1347] Generated new cluster ID: 52b9d7891dfa45cfb8700e421c4bbcd6
I20260807 07:00:50.490490 10130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:50.499963 10115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:50.473716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60587 (local address 127.10.191.190:46457)
0807 07:00:50.473935 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:50.473944 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:50.481832 (+ 7888us) server_negotiation.cc:407] Connection header received
0807 07:00:50.482413 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:50.482423 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:50.482525 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:50.482615 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:50.485324 (+ 2709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:50.486713 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:50.488754 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:50.489472 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:50.489577 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:50.493196 (+ 3619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:50.493203 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:50.493208 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:50.493244 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:50.496626 (+ 3382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:50.497593 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:50.497598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:50.497602 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:50.497756 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:50.498269 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:50.498274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:50.498277 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:50.498616 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:50.498851 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:50.499450 (+ 599us) server_negotiation.cc:299] Negotiation successful
0807 07:00:50.499617 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 07:00:50.515671 10130 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:50.517290 10130 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:50.528239 10130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 772c0f081b0748f0a02dbf70c7e31ba6: Generated new TSK 0
I20260807 07:00:50.529129 10130 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:50.535390 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10010
I20260807 07:00:50.537335 10105 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:50.627831 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 10010
W20260807 07:00:50.655076 9991 connection.cc:535] client connection to 127.10.191.190:46457 recv error: Network error: failed to read from TLS socket (remote: 127.10.191.190:46457): Connection reset by peer (error 104)
2026-08-07T07:00:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2315 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:50 dist-test-slave-tfpf krb5kdc[10168](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:50 dist-test-slave-tfpf krb5kdc[10168](info): set up 2 sockets
Aug 07 07:00:50 dist-test-slave-tfpf krb5kdc[10168](info): commencing operation
krb5kdc: starting...
W20260807 07:00:51.927537 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.001s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:52 dist-test-slave-tfpf krb5kdc[10168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:00:52.250401 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:41163
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:39693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:41163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:52.598320 10190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:52.598636 10190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:52.598829 10190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:52.606050 10190 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:52.606191 10190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:52.606303 10190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:52.606406 10190 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:52.606472 10190 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:52.616251 10190 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:39693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:41163
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:41163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:52.617688 10190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:52.619025 10190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:52.631896 10201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:52.631954 10204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:52.632462 10206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:52.632438 10190 server_base.cc:1034] running on GCE node
I20260807 07:00:52.633528 10190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:52.634918 10190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:52.636171 10190 hybrid_clock.cc:648] HybridClock initialized: now 1786086052636110 us; error 53 us; skew 500 ppm
I20260807 07:00:52.636579 10190 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:52 dist-test-slave-tfpf krb5kdc[10168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086052, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:52.639776 10190 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:00:52.641404 10190 webserver.cc:460] Webserver started at http://127.10.191.190:39659/ using document root <none> and password file <none>
I20260807 07:00:52.642104 10190 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:52.642263 10190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:52.642587 10190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:52.645674 10190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "0909456705834d2e84ccc19cb8fb37cd"
format_stamp: "Formatted at 2026-08-07 07:00:52 on dist-test-slave-tfpf"
server_key: "90a0413366771ce7040d5591c18135cb"
server_key_iv: "b9f1433d0982c291c780d5e0f2b0d2c6"
server_key_version: "encryptionkey@0"
I20260807 07:00:52.646551 10190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "0909456705834d2e84ccc19cb8fb37cd"
format_stamp: "Formatted at 2026-08-07 07:00:52 on dist-test-slave-tfpf"
server_key: "90a0413366771ce7040d5591c18135cb"
server_key_iv: "b9f1433d0982c291c780d5e0f2b0d2c6"
server_key_version: "encryptionkey@0"
I20260807 07:00:52.651934 10190 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 07:00:52.655419 10216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:52.656775 10190 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 07:00:52.656967 10190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "0909456705834d2e84ccc19cb8fb37cd"
format_stamp: "Formatted at 2026-08-07 07:00:52 on dist-test-slave-tfpf"
server_key: "90a0413366771ce7040d5591c18135cb"
server_key_iv: "b9f1433d0982c291c780d5e0f2b0d2c6"
server_key_version: "encryptionkey@0"
I20260807 07:00:52.657255 10190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:52.684835 10190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:52.688804 10190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:52.689137 10190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:52.708488 10190 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:41163
I20260807 07:00:52.708513 10291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:41163 every 8 connection(s)
I20260807 07:00:52.710029 10190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:52.711692 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 10190
I20260807 07:00:52.711895 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:52.712503 11006 external_mini_cluster.cc:1428] Setting key ba8a6b194c5d36cd2e277fbbebab1fe1
I20260807 07:00:52.715032 10292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:52.727735 10296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:52.714723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48151 (local address 127.10.191.190:41163)
0807 07:00:52.715731 (+ 1008us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:52.715747 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:52.716336 (+ 589us) server_negotiation.cc:407] Connection header received
0807 07:00:52.718218 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:52.718239 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:52.718625 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:52.718959 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:52.719726 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:52.721187 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:52.723111 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:52.723788 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:52.723916 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:52.725499 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:52.725507 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:52.725519 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:52.726058 (+ 539us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:52.726132 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:52.726159 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:52.726293 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:52.726613 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 07:00:52.726802 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":740,"thread_start_us":431,"threads_started":1}
I20260807 07:00:52.729128 10292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd: Bootstrap starting.
I20260807 07:00:52.731699 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:52.732823 10292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:52.734144 10292 log.cc:824] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:52.736922 10292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd: No bootstrap required, opened a new log
I20260807 07:00:52.744335 10296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:52.737644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48977 (local address 127.10.191.190:41163)
0807 07:00:52.737894 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:52.737900 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:52.738286 (+ 386us) server_negotiation.cc:407] Connection header received
0807 07:00:52.738510 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:52.738514 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:52.738572 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:52.738668 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:52.739278 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:52.740046 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:52.741967 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:52.742413 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:52.742505 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:52.743602 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:52.743607 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:52.743610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:52.743624 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:52.743667 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:52.743681 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:52.743758 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:52.743953 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 07:00:52.743996 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 07:00:52.746634 10292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0909456705834d2e84ccc19cb8fb37cd" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41163 } }
I20260807 07:00:52.746975 10292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:52.747098 10292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0909456705834d2e84ccc19cb8fb37cd, State: Initialized, Role: FOLLOWER
I20260807 07:00:52.747642 10292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0909456705834d2e84ccc19cb8fb37cd" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41163 } }
I20260807 07:00:52.747877 10292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:52.748040 10292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:52.748214 10292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:52.750396 10292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0909456705834d2e84ccc19cb8fb37cd" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41163 } }
I20260807 07:00:52.750931 10292 leader_election.cc:302] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0909456705834d2e84ccc19cb8fb37cd; no voters:
I20260807 07:00:52.751504 10292 leader_election.cc:288] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:52.751621 10305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:52.752389 10305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [term 1 LEADER]: Becoming Leader. State: Replica: 0909456705834d2e84ccc19cb8fb37cd, State: Running, Role: LEADER
I20260807 07:00:52.752943 10305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0909456705834d2e84ccc19cb8fb37cd" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41163 } }
I20260807 07:00:52.753762 10292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:52.755978 10310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0909456705834d2e84ccc19cb8fb37cd. Latest consensus state: current_term: 1 leader_uuid: "0909456705834d2e84ccc19cb8fb37cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0909456705834d2e84ccc19cb8fb37cd" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41163 } } }
I20260807 07:00:52.756117 10307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0909456705834d2e84ccc19cb8fb37cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0909456705834d2e84ccc19cb8fb37cd" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 41163 } } }
I20260807 07:00:52.756562 10307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:52.756562 10310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:52.757688 10320 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:52.763504 10320 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:52.772282 10320 catalog_manager.cc:1347] Generated new cluster ID: badc879bf5904350a7101e9a042f3a6f
I20260807 07:00:52.772411 10320 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:52.790248 10320 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:52.791565 10320 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:52.800597 10320 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0909456705834d2e84ccc19cb8fb37cd: Generated new TSK 0
I20260807 07:00:52.801455 10320 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:52.808557 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10190
W20260807 07:00:52.809877 10287 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48151
W20260807 07:00:52.810586 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10190: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:52.810738 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 10190
W20260807 07:00:52.837340 10164 connection.cc:535] client connection to 127.10.191.190:41163 recv error: Network error: failed to read from TLS socket (remote: 127.10.191.190:41163): Connection reset by peer (error 104)
2026-08-07T07:00:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2182 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:52 dist-test-slave-tfpf krb5kdc[10342](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:52 dist-test-slave-tfpf krb5kdc[10342](info): set up 2 sockets
Aug 07 07:00:52 dist-test-slave-tfpf krb5kdc[10342](info): commencing operation
krb5kdc: starting...
W20260807 07:00:54.108199 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:54 dist-test-slave-tfpf krb5kdc[10342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:00:54.446316 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42257
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:39265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:42257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:54.813354 10364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:54.813638 10364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:54.813820 10364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:54.820917 10364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:54.821059 10364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:54.821200 10364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:54.821321 10364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:54.821414 10364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:54.830739 10364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:39265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:42257
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:42257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:54.832026 10364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:54.833447 10364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:54.845661 10379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:54.845762 10373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:54.845731 10374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:54.846596 10364 server_base.cc:1034] running on GCE node
I20260807 07:00:54.847400 10364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:54.848839 10364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:54.850113 10364 hybrid_clock.cc:648] HybridClock initialized: now 1786086054850030 us; error 68 us; skew 500 ppm
I20260807 07:00:54.850474 10364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:54 dist-test-slave-tfpf krb5kdc[10342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086054, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:54.853719 10364 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:00:54.855262 10364 webserver.cc:460] Webserver started at http://127.10.191.190:39607/ using document root <none> and password file <none>
I20260807 07:00:54.855922 10364 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:54.856078 10364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:54.856389 10364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:54.859681 10364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce"
format_stamp: "Formatted at 2026-08-07 07:00:54 on dist-test-slave-tfpf"
server_key: "0102bd983d64c4d470274e9ff6dc7a13"
server_key_iv: "bb2fc00cb6f45d355541da0b696c21ab"
server_key_version: "encryptionkey@0"
I20260807 07:00:54.860522 10364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce"
format_stamp: "Formatted at 2026-08-07 07:00:54 on dist-test-slave-tfpf"
server_key: "0102bd983d64c4d470274e9ff6dc7a13"
server_key_iv: "bb2fc00cb6f45d355541da0b696c21ab"
server_key_version: "encryptionkey@0"
I20260807 07:00:54.865985 10364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260807 07:00:54.870157 10388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:54.871539 10364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 07:00:54.871742 10364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce"
format_stamp: "Formatted at 2026-08-07 07:00:54 on dist-test-slave-tfpf"
server_key: "0102bd983d64c4d470274e9ff6dc7a13"
server_key_iv: "bb2fc00cb6f45d355541da0b696c21ab"
server_key_version: "encryptionkey@0"
I20260807 07:00:54.871990 10364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:54.878077 10364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:54.882030 10364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:54.882319 10364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:54.902073 10364 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:42257
I20260807 07:00:54.902094 10457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:42257 every 8 connection(s)
I20260807 07:00:54.903527 10364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:54.907127 10459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:54.908913 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 10364
I20260807 07:00:54.909125 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:54.909591 11006 external_mini_cluster.cc:1428] Setting key 2b2897b2174eeefe5a0d64b5dcf65039
I20260807 07:00:54.917251 10462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:54.911457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60685 (local address 127.10.191.190:42257)
0807 07:00:54.912329 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:54.912340 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:54.912382 (+ 42us) server_negotiation.cc:407] Connection header received
0807 07:00:54.913984 (+ 1602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:54.914008 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:54.914318 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:54.914620 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:54.915646 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:54.915656 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:54.915667 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:54.915681 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:54.915752 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:54.915774 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:54.915969 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:54.916076 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 07:00:54.916295 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":421,"threads_started":1}
I20260807 07:00:54.918620 10459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce: Bootstrap starting.
I20260807 07:00:54.921008 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:54.921959 10459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:54.922968 10459 log.cc:824] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:54.926000 10459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce: No bootstrap required, opened a new log
I20260807 07:00:54.927879 10462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:54.925403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54223 (local address 127.10.191.190:42257)
0807 07:00:54.925599 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:54.925607 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:54.925992 (+ 385us) server_negotiation.cc:407] Connection header received
0807 07:00:54.926229 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:54.926234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:54.926294 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:54.926392 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:54.927250 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:54.927255 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:54.927259 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:54.927276 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:54.927323 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:54.927345 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:54.927468 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:54.927525 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 07:00:54.927579 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 07:00:54.933964 10459 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42257 } }
I20260807 07:00:54.934351 10459 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:54.934473 10459 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e0fb9f8d5e74b1b9916f2a45e9c53ce, State: Initialized, Role: FOLLOWER
I20260807 07:00:54.935034 10459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42257 } }
I20260807 07:00:54.935273 10459 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:54.935426 10459 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:54.935614 10459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:54.937901 10459 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42257 } }
I20260807 07:00:54.938418 10459 leader_election.cc:302] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e0fb9f8d5e74b1b9916f2a45e9c53ce; no voters:
I20260807 07:00:54.938987 10459 leader_election.cc:288] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:54.939132 10478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:54.940207 10478 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [term 1 LEADER]: Becoming Leader. State: Replica: 8e0fb9f8d5e74b1b9916f2a45e9c53ce, State: Running, Role: LEADER
I20260807 07:00:54.940804 10478 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42257 } }
I20260807 07:00:54.941345 10459 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:54.943650 10479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42257 } } }
I20260807 07:00:54.944031 10479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:54.945329 10480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e0fb9f8d5e74b1b9916f2a45e9c53ce. Latest consensus state: current_term: 1 leader_uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0fb9f8d5e74b1b9916f2a45e9c53ce" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 42257 } } }
I20260807 07:00:54.945637 10480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:54.946925 10488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:54.951520 10488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:54.959120 10488 catalog_manager.cc:1347] Generated new cluster ID: b0d8f590a2f14c368e21fb1e67980db8
I20260807 07:00:54.959280 10488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:54.975387 10488 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:54.975814 10488 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:54.988590 10488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e0fb9f8d5e74b1b9916f2a45e9c53ce: Generated new TSK 0
I20260807 07:00:54.989668 10488 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:55.002230 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10364
W20260807 07:00:55.003377 10447 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60685
W20260807 07:00:55.004048 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10364: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:55.004236 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 10364
2026-08-07T07:00:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2193 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:55 dist-test-slave-tfpf krb5kdc[10517](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:55 dist-test-slave-tfpf krb5kdc[10517](info): set up 2 sockets
Aug 07 07:00:55 dist-test-slave-tfpf krb5kdc[10517](info): commencing operation
krb5kdc: starting...
W20260807 07:00:56.304814 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.003s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:56 dist-test-slave-tfpf krb5kdc[10517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:00:56.649727 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:34957
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:43475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:34957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:57.007798 10536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:57.008093 10536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:57.008185 10536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:57.015362 10536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:57.015475 10536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:57.015523 10536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:57.015578 10536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:57.015614 10536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:57.025445 10536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:43475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:34957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:34957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:57.026655 10536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:57.027976 10536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:57.039968 10545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:57.039924 10548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:57.040009 10542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:57.041045 10536 server_base.cc:1034] running on GCE node
I20260807 07:00:57.041909 10536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:57.043315 10536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:57.044520 10536 hybrid_clock.cc:648] HybridClock initialized: now 1786086057044473 us; error 41 us; skew 500 ppm
I20260807 07:00:57.044862 10536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:57 dist-test-slave-tfpf krb5kdc[10517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086057, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:57.047942 10536 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:00:57.049430 10536 webserver.cc:460] Webserver started at http://127.10.191.190:34229/ using document root <none> and password file <none>
I20260807 07:00:57.050093 10536 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:57.050215 10536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:57.050519 10536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:57.053540 10536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "4e6a0cdf56ef433083d1cbd6d432a12b"
format_stamp: "Formatted at 2026-08-07 07:00:57 on dist-test-slave-tfpf"
server_key: "de153c2e5b758ab3f3fba79751aac143"
server_key_iv: "5f0ca74a508cb3b4b7550bf688d7d77c"
server_key_version: "encryptionkey@0"
I20260807 07:00:57.054276 10536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "4e6a0cdf56ef433083d1cbd6d432a12b"
format_stamp: "Formatted at 2026-08-07 07:00:57 on dist-test-slave-tfpf"
server_key: "de153c2e5b758ab3f3fba79751aac143"
server_key_iv: "5f0ca74a508cb3b4b7550bf688d7d77c"
server_key_version: "encryptionkey@0"
I20260807 07:00:57.059418 10536 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 07:00:57.062775 10556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:57.064065 10536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 07:00:57.064242 10536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "4e6a0cdf56ef433083d1cbd6d432a12b"
format_stamp: "Formatted at 2026-08-07 07:00:57 on dist-test-slave-tfpf"
server_key: "de153c2e5b758ab3f3fba79751aac143"
server_key_iv: "5f0ca74a508cb3b4b7550bf688d7d77c"
server_key_version: "encryptionkey@0"
I20260807 07:00:57.064426 10536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:57.083765 10536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:57.087682 10536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:57.087984 10536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:57.107172 10536 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:34957
I20260807 07:00:57.107208 10629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:34957 every 8 connection(s)
I20260807 07:00:57.108538 10536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:57.112377 10631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:57.114400 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 10536
I20260807 07:00:57.114599 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:57.115021 11006 external_mini_cluster.cc:1428] Setting key f43f1604715fa099d9d18dbd7b80eb69
I20260807 07:00:57.124742 10631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b: Bootstrap starting.
I20260807 07:00:57.128757 10631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b: Neither blocks nor log segments found. Creating new log.
Aug 07 07:00:57 dist-test-slave-tfpf krb5kdc[10517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:00:57.130020 10631 log.cc:824] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:57.133239 10631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b: No bootstrap required, opened a new log
I20260807 07:00:57.138273 10635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:57.116835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54969 (local address 127.10.191.190:34957)
0807 07:00:57.117723 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:57.117735 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:57.117778 (+ 43us) server_negotiation.cc:407] Connection header received
0807 07:00:57.119480 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:57.119502 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:57.119876 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:57.120199 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:57.122086 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:57.123427 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:57.125210 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:57.125833 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:57.125982 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:57.130899 (+ 4917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:57.130907 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:57.130920 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:57.130957 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:57.134133 (+ 3176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:57.134892 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:57.134898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:57.134904 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:57.135089 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:57.135533 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:57.135536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:57.135538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:57.136096 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:57.136321 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:57.136789 (+ 468us) server_negotiation.cc:299] Negotiation successful
0807 07:00:57.137213 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":452,"threads_started":1}
I20260807 07:00:57.142089 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:57.142638 10631 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6a0cdf56ef433083d1cbd6d432a12b" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 34957 } }
I20260807 07:00:57.143002 10631 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:57.143107 10631 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e6a0cdf56ef433083d1cbd6d432a12b, State: Initialized, Role: FOLLOWER
I20260807 07:00:57.143698 10631 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6a0cdf56ef433083d1cbd6d432a12b" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 34957 } }
I20260807 07:00:57.143944 10631 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:57.144085 10631 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:57.144256 10631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:57.146634 10631 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6a0cdf56ef433083d1cbd6d432a12b" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 34957 } }
I20260807 07:00:57.147166 10631 leader_election.cc:302] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e6a0cdf56ef433083d1cbd6d432a12b; no voters:
I20260807 07:00:57.147811 10631 leader_election.cc:288] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:57.147930 10647 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:57.149749 10647 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [term 1 LEADER]: Becoming Leader. State: Replica: 4e6a0cdf56ef433083d1cbd6d432a12b, State: Running, Role: LEADER
I20260807 07:00:57.150305 10631 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:57.150390 10647 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6a0cdf56ef433083d1cbd6d432a12b" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 34957 } }
I20260807 07:00:57.154970 10648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e6a0cdf56ef433083d1cbd6d432a12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6a0cdf56ef433083d1cbd6d432a12b" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 34957 } } }
I20260807 07:00:57.155046 10650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e6a0cdf56ef433083d1cbd6d432a12b. Latest consensus state: current_term: 1 leader_uuid: "4e6a0cdf56ef433083d1cbd6d432a12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e6a0cdf56ef433083d1cbd6d432a12b" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 34957 } } }
I20260807 07:00:57.155447 10648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:57.155480 10650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:57.156545 10661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:57.163414 10661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:57.163926 10635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:57.146581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34357 (local address 127.10.191.190:34957)
0807 07:00:57.146762 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:57.146767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:57.147335 (+ 568us) server_negotiation.cc:407] Connection header received
0807 07:00:57.147517 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:57.147522 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:57.147588 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:57.147682 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:57.149505 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:57.150513 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:57.151856 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:57.152621 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:57.152780 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:57.155993 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:57.156003 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:57.156028 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:00:57.156073 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:57.159785 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:57.160615 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:57.160619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:57.160621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:57.160732 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:00:57.161254 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:00:57.161266 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:00:57.161270 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:00:57.161758 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:57.163125 (+ 1367us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:57.163287 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 07:00:57.163547 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 07:00:57.175189 10661 catalog_manager.cc:1347] Generated new cluster ID: df548bc751af4646ac809e2c78129542
I20260807 07:00:57.175310 10661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:57.189126 10661 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:57.190234 10661 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:57.197322 10661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e6a0cdf56ef433083d1cbd6d432a12b: Generated new TSK 0
I20260807 07:00:57.198108 10661 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:57.204895 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10536
I20260807 07:00:57.206090 10625 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:00:57.292543 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 10536
2026-08-07T07:00:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2286 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:57 dist-test-slave-tfpf krb5kdc[10674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:57 dist-test-slave-tfpf krb5kdc[10674](info): set up 2 sockets
Aug 07 07:00:57 dist-test-slave-tfpf krb5kdc[10674](info): commencing operation
krb5kdc: starting...
W20260807 07:00:58.592414 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.004s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:00:58 dist-test-slave-tfpf krb5kdc[10674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:00:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:00:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:00:58.920560 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:40649
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:41959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:40649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:00:59.261757 10693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:00:59.262028 10693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:00:59.262120 10693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:00:59.268718 10693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:00:59.268807 10693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:00:59.268849 10693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:00:59.268898 10693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:00:59.268949 10693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:00:59.278250 10693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:41959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:40649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:40649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:00:59.279538 10693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:00:59.280910 10693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:00:59.293078 10704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:59.293162 10698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:00:59.293413 10699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:00:59.293970 10693 server_base.cc:1034] running on GCE node
I20260807 07:00:59.294697 10693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:00:59.296000 10693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:00:59.297155 10693 hybrid_clock.cc:648] HybridClock initialized: now 1786086059297093 us; error 52 us; skew 500 ppm
I20260807 07:00:59.297454 10693 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:00:59 dist-test-slave-tfpf krb5kdc[10674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086059, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:00:59.300490 10693 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:00:59.302091 10693 webserver.cc:460] Webserver started at http://127.10.191.190:35747/ using document root <none> and password file <none>
I20260807 07:00:59.302780 10693 fs_manager.cc:359] Metadata directory not provided
I20260807 07:00:59.302938 10693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:00:59.303339 10693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:00:59.306568 10693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "78732c73183e4574badb05b0f8e8d554"
format_stamp: "Formatted at 2026-08-07 07:00:59 on dist-test-slave-tfpf"
server_key: "c8b5cd887e70a5755c3288f97aae9259"
server_key_iv: "9db473efdea712cdda2127ab467dd087"
server_key_version: "encryptionkey@0"
I20260807 07:00:59.307313 10693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "78732c73183e4574badb05b0f8e8d554"
format_stamp: "Formatted at 2026-08-07 07:00:59 on dist-test-slave-tfpf"
server_key: "c8b5cd887e70a5755c3288f97aae9259"
server_key_iv: "9db473efdea712cdda2127ab467dd087"
server_key_version: "encryptionkey@0"
I20260807 07:00:59.312451 10693 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 07:00:59.315771 10718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:00:59.317034 10693 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 07:00:59.317258 10693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "78732c73183e4574badb05b0f8e8d554"
format_stamp: "Formatted at 2026-08-07 07:00:59 on dist-test-slave-tfpf"
server_key: "c8b5cd887e70a5755c3288f97aae9259"
server_key_iv: "9db473efdea712cdda2127ab467dd087"
server_key_version: "encryptionkey@0"
I20260807 07:00:59.317446 10693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:00:59.333688 10693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:00:59.337565 10693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:00:59.337848 10693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:00:59.355935 10693 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:40649
I20260807 07:00:59.355969 10785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:40649 every 8 connection(s)
I20260807 07:00:59.357297 10693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:00:59.360854 10786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:00:59.363161 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 10693
I20260807 07:00:59.363348 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:00:59.363788 11006 external_mini_cluster.cc:1428] Setting key e29fe7a2545a8f5f7618a2d35084b873
I20260807 07:00:59.372776 10786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554: Bootstrap starting.
I20260807 07:00:59.376380 10786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554: Neither blocks nor log segments found. Creating new log.
I20260807 07:00:59.376698 10792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:59.365482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42683 (local address 127.10.191.190:40649)
0807 07:00:59.366302 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:59.366313 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:59.366356 (+ 43us) server_negotiation.cc:407] Connection header received
0807 07:00:59.367992 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:59.368013 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:59.368380 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:59.368674 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:59.369332 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:59.370585 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:59.372461 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:59.373216 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:59.373363 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:59.374556 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:59.374563 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:59.374574 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:59.375083 (+ 509us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:59.375155 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:59.375179 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:59.375263 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:59.375488 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 07:00:59.375733 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":382,"threads_started":1}
I20260807 07:00:59.377636 10786 log.cc:824] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554: Log is configured to *not* fsync() on all Append() calls
I20260807 07:00:59.380542 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:00:59.380828 10786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554: No bootstrap required, opened a new log
I20260807 07:00:59.388810 10786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78732c73183e4574badb05b0f8e8d554" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40649 } }
I20260807 07:00:59.389225 10786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:00:59.389341 10786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78732c73183e4574badb05b0f8e8d554, State: Initialized, Role: FOLLOWER
I20260807 07:00:59.389991 10786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78732c73183e4574badb05b0f8e8d554" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40649 } }
I20260807 07:00:59.390321 10786 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:00:59.390528 10792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:00:59.384830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55255 (local address 127.10.191.190:40649)
0807 07:00:59.384956 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0807 07:00:59.384960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:00:59.385483 (+ 523us) server_negotiation.cc:407] Connection header received
0807 07:00:59.385670 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:00:59.385674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:00:59.385733 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:00:59.385829 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:00:59.386330 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:59.386938 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:59.388237 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:00:59.388698 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:00:59.388841 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:00:59.389898 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:00:59.389902 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:00:59.389905 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:00:59.389920 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:00:59.389955 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:00:59.389969 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:00:59.390042 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 07:00:59.390198 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 07:00:59.390293 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 07:00:59.390684 10786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:00:59.390863 10786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:00:59.393270 10786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78732c73183e4574badb05b0f8e8d554" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40649 } }
I20260807 07:00:59.393704 10786 leader_election.cc:302] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78732c73183e4574badb05b0f8e8d554; no voters:
I20260807 07:00:59.394275 10786 leader_election.cc:288] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:00:59.394369 10803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:00:59.395375 10803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [term 1 LEADER]: Becoming Leader. State: Replica: 78732c73183e4574badb05b0f8e8d554, State: Running, Role: LEADER
I20260807 07:00:59.395952 10803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78732c73183e4574badb05b0f8e8d554" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40649 } }
I20260807 07:00:59.396513 10786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:00:59.398880 10806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78732c73183e4574badb05b0f8e8d554. Latest consensus state: current_term: 1 leader_uuid: "78732c73183e4574badb05b0f8e8d554" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78732c73183e4574badb05b0f8e8d554" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40649 } } }
I20260807 07:00:59.399271 10806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:59.398964 10805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78732c73183e4574badb05b0f8e8d554" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78732c73183e4574badb05b0f8e8d554" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 40649 } } }
I20260807 07:00:59.399400 10805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554 [sys.catalog]: This master's current role is: LEADER
I20260807 07:00:59.400946 10810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:00:59.408470 10810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:00:59.417965 10810 catalog_manager.cc:1347] Generated new cluster ID: 258137847ccc48afadcb054c2179d16c
I20260807 07:00:59.418066 10810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:00:59.456332 10810 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:00:59.458280 10810 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:00:59.478089 10810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78732c73183e4574badb05b0f8e8d554: Generated new TSK 0
I20260807 07:00:59.478960 10810 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:00:59.494602 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10693
W20260807 07:00:59.495581 10779 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42683
W20260807 07:00:59.496260 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10693: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:00:59.496426 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 10693
2026-08-07T07:00:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2203 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:00:59 dist-test-slave-tfpf krb5kdc[10831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:00:59 dist-test-slave-tfpf krb5kdc[10831](info): set up 2 sockets
Aug 07 07:00:59 dist-test-slave-tfpf krb5kdc[10831](info): commencing operation
krb5kdc: starting...
W20260807 07:01:00.809521 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.003s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:01:01 dist-test-slave-tfpf krb5kdc[10831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086061, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:01:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:01:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:01:01.129767 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:33679
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:45485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:33679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:01:01.482263 10848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:01:01.482638 10848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:01:01.482795 10848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:01:01.489884 10848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:01:01.490047 10848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:01:01.490154 10848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:01:01.490268 10848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:01:01.490347 10848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:01:01.500401 10848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:45485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:33679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:33679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:01:01.501880 10848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:01:01.503302 10848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:01:01.515615 10856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:01.515678 10857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:01.515825 10859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:01:01.516469 10848 server_base.cc:1034] running on GCE node
I20260807 07:01:01.517344 10848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:01:01.518754 10848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:01:01.520006 10848 hybrid_clock.cc:648] HybridClock initialized: now 1786086061519970 us; error 41 us; skew 500 ppm
I20260807 07:01:01.520364 10848 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:01:01 dist-test-slave-tfpf krb5kdc[10831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086061, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:01:01.528021 10848 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:01:01.529569 10848 webserver.cc:460] Webserver started at http://127.10.191.190:38539/ using document root <none> and password file <none>
I20260807 07:01:01.530248 10848 fs_manager.cc:359] Metadata directory not provided
I20260807 07:01:01.530392 10848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:01:01.530716 10848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:01:01.533746 10848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "185c76f19ed9404e9b5ba016e9b07176"
format_stamp: "Formatted at 2026-08-07 07:01:01 on dist-test-slave-tfpf"
server_key: "d3a0d6a30f0bddb771998bc2ec5b5da7"
server_key_iv: "fbbcc5555f87eda49033ba10cd4f76eb"
server_key_version: "encryptionkey@0"
I20260807 07:01:01.534510 10848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "185c76f19ed9404e9b5ba016e9b07176"
format_stamp: "Formatted at 2026-08-07 07:01:01 on dist-test-slave-tfpf"
server_key: "d3a0d6a30f0bddb771998bc2ec5b5da7"
server_key_iv: "fbbcc5555f87eda49033ba10cd4f76eb"
server_key_version: "encryptionkey@0"
I20260807 07:01:01.539826 10848 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 07:01:01.543239 10873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:01:01.544584 10848 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 07:01:01.544765 10848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "185c76f19ed9404e9b5ba016e9b07176"
format_stamp: "Formatted at 2026-08-07 07:01:01 on dist-test-slave-tfpf"
server_key: "d3a0d6a30f0bddb771998bc2ec5b5da7"
server_key_iv: "fbbcc5555f87eda49033ba10cd4f76eb"
server_key_version: "encryptionkey@0"
I20260807 07:01:01.544968 10848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:01:01.550875 10848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:01:01.555043 10848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:01:01.555346 10848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:01:01.574535 10848 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:33679
I20260807 07:01:01.574582 10944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:33679 every 8 connection(s)
I20260807 07:01:01.575904 10848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:01:01.579705 10947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:01:01.582391 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 10848
I20260807 07:01:01.582614 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:01:01.583179 11006 external_mini_cluster.cc:1428] Setting key f98afc892521f79d5bb3a1e8c671778d
I20260807 07:01:01.591105 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:01.585197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48275 (local address 127.10.191.190:33679)
0807 07:01:01.586025 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:01.586037 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:01.586076 (+ 39us) server_negotiation.cc:407] Connection header received
0807 07:01:01.587710 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:01.587734 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:01.588050 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:01.588433 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:01.589511 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:01.589517 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:01.589532 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:01:01.589548 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:01.589614 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:01:01.589636 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:01.589886 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:01.590033 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 07:01:01.590212 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":356,"threads_started":1}
I20260807 07:01:01.592161 10947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176: Bootstrap starting.
I20260807 07:01:01.594678 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:01:01.595566 10947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176: Neither blocks nor log segments found. Creating new log.
I20260807 07:01:01.596576 10947 log.cc:824] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176: Log is configured to *not* fsync() on all Append() calls
I20260807 07:01:01.599984 10947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176: No bootstrap required, opened a new log
I20260807 07:01:01.601807 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:01.599064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35799 (local address 127.10.191.190:33679)
0807 07:01:01.599204 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:01.599208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:01.599796 (+ 588us) server_negotiation.cc:407] Connection header received
0807 07:01:01.599988 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:01.599994 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:01.600075 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:01.600183 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:01.601136 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:01.601142 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:01.601147 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 07:01:01.601169 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:01.601206 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 07:01:01.601227 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:01.601356 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:01.601472 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 07:01:01.601527 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 07:01:01.608146 10947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185c76f19ed9404e9b5ba016e9b07176" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 33679 } }
I20260807 07:01:01.608523 10947 raft_consensus.cc:374] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:01:01.608639 10947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185c76f19ed9404e9b5ba016e9b07176, State: Initialized, Role: FOLLOWER
I20260807 07:01:01.609408 10947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185c76f19ed9404e9b5ba016e9b07176" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 33679 } }
I20260807 07:01:01.609676 10947 raft_consensus.cc:388] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:01:01.609841 10947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:01:01.610019 10947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:01:01.612213 10947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185c76f19ed9404e9b5ba016e9b07176" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 33679 } }
I20260807 07:01:01.612744 10947 leader_election.cc:302] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 185c76f19ed9404e9b5ba016e9b07176; no voters:
I20260807 07:01:01.613370 10947 leader_election.cc:288] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:01:01.613498 10958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:01:01.614265 10958 raft_consensus.cc:686] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [term 1 LEADER]: Becoming Leader. State: Replica: 185c76f19ed9404e9b5ba016e9b07176, State: Running, Role: LEADER
I20260807 07:01:01.614794 10958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185c76f19ed9404e9b5ba016e9b07176" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 33679 } }
I20260807 07:01:01.615550 10947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:01:01.622246 10961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 185c76f19ed9404e9b5ba016e9b07176. Latest consensus state: current_term: 1 leader_uuid: "185c76f19ed9404e9b5ba016e9b07176" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185c76f19ed9404e9b5ba016e9b07176" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 33679 } } }
I20260807 07:01:01.622798 10959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "185c76f19ed9404e9b5ba016e9b07176" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185c76f19ed9404e9b5ba016e9b07176" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 33679 } } }
I20260807 07:01:01.623296 10961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [sys.catalog]: This master's current role is: LEADER
I20260807 07:01:01.623306 10959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176 [sys.catalog]: This master's current role is: LEADER
W20260807 07:01:01.627009 10977 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 07:01:01.627135 10977 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 07:01:01.627264 10981 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:01:01.629403 10981 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:01:01.637655 10981 catalog_manager.cc:1347] Generated new cluster ID: b67c029b83a24230bb728edf83c2f204
I20260807 07:01:01.637758 10981 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:01:01.658380 10981 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:01:01.658793 10981 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:01:01.669206 10981 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 185c76f19ed9404e9b5ba016e9b07176: Generated new TSK 0
I20260807 07:01:01.670004 10981 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:01:01.677794 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10848
W20260807 07:01:01.679291 10939 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48275
W20260807 07:01:01.680001 11006 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 10848: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 07:01:01.680150 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 10848
2026-08-07T07:01:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2189 ms)
[----------] 18 tests from AuthTokenIssuingTest (39261 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:01:01 dist-test-slave-tfpf krb5kdc[10994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:01:01 dist-test-slave-tfpf krb5kdc[10994](info): set up 2 sockets
Aug 07 07:01:01 dist-test-slave-tfpf krb5kdc[10994](info): commencing operation
krb5kdc: starting...
W20260807 07:01:03.005350 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:01:03 dist-test-slave-tfpf krb5kdc[10994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:01:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:01:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
I20260807 07:01:03.346145 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:39529
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:39529,127.10.191.189:38993,127.10.191.188:39157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:01:03.697583 11023 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 07:01:03.697961 11023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:01:03.698092 11023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:01:03.698248 11023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:01:03.705441 11023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:01:03.705559 11023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:01:03.705663 11023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:01:03.705762 11023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:01:03.705865 11023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:01:03.715656 11023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:39529,127.10.191.189:38993,127.10.191.188:39157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:39529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:01:03.717020 11023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:01:03.718386 11023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:01:03.730638 11030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:03.730763 11028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:03.730966 11034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:01:03.731794 11023 server_base.cc:1034] running on GCE node
I20260807 07:01:03.732520 11023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:01:03.733932 11023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:01:03.735185 11023 hybrid_clock.cc:648] HybridClock initialized: now 1786086063735111 us; error 48 us; skew 500 ppm
I20260807 07:01:03.735533 11023 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:01:03 dist-test-slave-tfpf krb5kdc[10994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086063, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:01:03.738768 11023 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:01:03.740130 11023 webserver.cc:460] Webserver started at http://127.10.191.190:39929/ using document root <none> and password file <none>
I20260807 07:01:03.740826 11023 fs_manager.cc:359] Metadata directory not provided
I20260807 07:01:03.740967 11023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:01:03.741353 11023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:01:03.744334 11023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "7b370eb9b98f4b1ea71a83c864421376"
format_stamp: "Formatted at 2026-08-07 07:01:03 on dist-test-slave-tfpf"
server_key: "1d37c5a151149ca0f76fda867165e370"
server_key_iv: "7e01e94494af282d09edfd7a1e0ece7a"
server_key_version: "encryptionkey@0"
I20260807 07:01:03.745229 11023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "7b370eb9b98f4b1ea71a83c864421376"
format_stamp: "Formatted at 2026-08-07 07:01:03 on dist-test-slave-tfpf"
server_key: "1d37c5a151149ca0f76fda867165e370"
server_key_iv: "7e01e94494af282d09edfd7a1e0ece7a"
server_key_version: "encryptionkey@0"
I20260807 07:01:03.750455 11023 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 07:01:03.754038 11042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:01:03.755295 11023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 07:01:03.755481 11023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "7b370eb9b98f4b1ea71a83c864421376"
format_stamp: "Formatted at 2026-08-07 07:01:03 on dist-test-slave-tfpf"
server_key: "1d37c5a151149ca0f76fda867165e370"
server_key_iv: "7e01e94494af282d09edfd7a1e0ece7a"
server_key_version: "encryptionkey@0"
I20260807 07:01:03.755716 11023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:01:03.771733 11023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:01:03.775643 11023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:01:03.775915 11023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:01:03.794726 11023 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:39529
I20260807 07:01:03.794746 11126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:39529 every 8 connection(s)
I20260807 07:01:03.796072 11023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:01:03.800117 11128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:01:03.800151 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11023
I20260807 07:01:03.800379 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:01:03.801041 11006 external_mini_cluster.cc:1428] Setting key 371def8b7b3eb68add45f0ac5b4fc95a
I20260807 07:01:03.806738 11128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 07:01:03 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086063, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:01:03.829676 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:03.809824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:39529 (local address 127.0.0.1:57150)
0807 07:01:03.810595 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:03.810644 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:03.812583 (+ 1939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:03.813426 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:03.813432 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:03.814126 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:03.814445 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:03.814460 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:03.816012 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:03.816017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:03.817281 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:03.817299 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:03.818267 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:03.818278 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:03.818445 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:03.819128 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:03.819149 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:03.821317 (+ 2168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:03.825707 (+ 4390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:03.825717 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:03.825725 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:03.826116 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:03.826578 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:03.826582 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:03.826584 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:03.826725 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:03.827727 (+ 1002us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:03.827733 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:03.827923 (+ 190us) client_negotiation.cc:769] Sending connection context
0807 07:01:03.828137 (+ 214us) client_negotiation.cc:240] Negotiation successful
0807 07:01:03.828509 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":340,"threads_started":1}
I20260807 07:01:03.829721 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:03.809824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57150 (local address 127.10.191.190:39529)
0807 07:01:03.811384 (+ 1560us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:03.811392 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:03.811441 (+ 49us) server_negotiation.cc:407] Connection header received
0807 07:01:03.812937 (+ 1496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:03.812942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:03.813215 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:03.813405 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:03.814664 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:03.815851 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:03.817440 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:03.818007 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:03.818155 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:03.821568 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:03.821584 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:03.821604 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:03.821659 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:03.825583 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:03.826261 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:03.826272 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:03.826278 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:03.826470 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:03.826850 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:03.826858 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:03.826864 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:03.827575 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:03.827807 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:03.828373 (+ 566us) server_negotiation.cc:299] Negotiation successful
0807 07:01:03.828692 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1356,"thread_start_us":1160,"threads_started":1}
I20260807 07:01:03.832641 11128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } has no permanent_uuid. Determining permanent_uuid...
I20260807 07:01:03.833762 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:03.833370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59148)
0807 07:01:03.833537 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:03.833652 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 07:01:03.834110 11044 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
I20260807 07:01:03.835667 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:03.835340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59162)
0807 07:01:03.835479 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:03.835543 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 07:01:03.835984 11128 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:38993: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.10.191.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab.
Entry for principal kudu/127.10.191.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab.
I20260807 07:01:03.879832 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.189:38993
--webserver_interface=127.10.191.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab
--principal=kudu/127.10.191.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:39529,127.10.191.189:38993,127.10.191.188:39157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 07:01:03.885347 11128 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } attempt: 1
I20260807 07:01:03.886686 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:03.886103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59176)
0807 07:01:03.886346 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:03.886487 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 07:01:03.887749 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:03.887322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59192)
0807 07:01:03.887494 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:03.887579 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 07:01:03.887954 11128 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:38993: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
I20260807 07:01:03.956185 11128 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } attempt: 2
I20260807 07:01:03.957509 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:03.956980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59196)
0807 07:01:03.957274 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:03.957367 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260807 07:01:03.958545 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:03.958175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59200)
0807 07:01:03.958326 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:03.958413 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 07:01:03.958737 11128 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:38993: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
I20260807 07:01:04.050122 11128 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } attempt: 3
I20260807 07:01:04.051323 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.050881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59210)
0807 07:01:04.051100 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.051189 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 07:01:04.052582 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.052204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59218)
0807 07:01:04.052391 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.052457 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 07:01:04.052904 11128 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:38993: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
I20260807 07:01:04.196228 11128 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } attempt: 4
I20260807 07:01:04.197576 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.196997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59232)
0807 07:01:04.197348 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.197438 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209}
I20260807 07:01:04.198724 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.198378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59244)
0807 07:01:04.198518 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.198600 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 07:01:04.198938 11128 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:38993: Network error: Client connection negotiation failed: client connection to 127.10.191.189:38993: connect: Connection refused (error 111)
W20260807 07:01:04.228432 11140 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 07:01:04.228792 11140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:01:04.228873 11140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:01:04.228955 11140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:01:04.236239 11140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:01:04.236325 11140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:01:04.236382 11140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:01:04.236435 11140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:01:04.236495 11140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:01:04.246042 11140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:39529,127.10.191.189:38993,127.10.191.188:39157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab
--principal=kudu/127.10.191.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.189:38993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.191.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:01:04.247231 11140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:01:04.248487 11140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:01:04.260895 11147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:04.260895 11148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:04.261088 11150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:01:04.262578 11140 server_base.cc:1034] running on GCE node
I20260807 07:01:04.263275 11140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:01:04.264534 11140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:01:04.265741 11140 hybrid_clock.cc:648] HybridClock initialized: now 1786086064265690 us; error 23 us; skew 500 ppm
I20260807 07:01:04.266068 11140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086064, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:01:04.269176 11140 init.cc:377] Logged in from keytab as kudu/127.10.191.189@KRBTEST.COM (short username kudu)
I20260807 07:01:04.270593 11140 webserver.cc:460] Webserver started at http://127.10.191.189:39431/ using document root <none> and password file <none>
I20260807 07:01:04.271265 11140 fs_manager.cc:359] Metadata directory not provided
I20260807 07:01:04.271351 11140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:01:04.271621 11140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:01:04.274550 11140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/data/instance:
uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8"
format_stamp: "Formatted at 2026-08-07 07:01:04 on dist-test-slave-tfpf"
server_key: "390c6e2cb3e707a860d4e2cb7c441a67"
server_key_iv: "50e7af3bc73be10c399b43415c29d9cc"
server_key_version: "encryptionkey@0"
I20260807 07:01:04.275278 11140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/wal/instance:
uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8"
format_stamp: "Formatted at 2026-08-07 07:01:04 on dist-test-slave-tfpf"
server_key: "390c6e2cb3e707a860d4e2cb7c441a67"
server_key_iv: "50e7af3bc73be10c399b43415c29d9cc"
server_key_version: "encryptionkey@0"
I20260807 07:01:04.280298 11140 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 07:01:04.283538 11159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:01:04.284924 11140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 07:01:04.285176 11140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/wal
uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8"
format_stamp: "Formatted at 2026-08-07 07:01:04 on dist-test-slave-tfpf"
server_key: "390c6e2cb3e707a860d4e2cb7c441a67"
server_key_iv: "50e7af3bc73be10c399b43415c29d9cc"
server_key_version: "encryptionkey@0"
I20260807 07:01:04.285382 11140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:01:04.305734 11140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:01:04.309742 11140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:01:04.310031 11140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:01:04.329342 11140 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.189:38993
I20260807 07:01:04.329329 11234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.189:38993 every 8 connection(s)
I20260807 07:01:04.330868 11140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
I20260807 07:01:04.334584 11235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:01:04.336043 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11140
I20260807 07:01:04.336251 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-1/wal/instance
I20260807 07:01:04.336824 11006 external_mini_cluster.cc:1428] Setting key 1326440699cd2d824afec8e1566e304d
I20260807 07:01:04.344285 11235 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086064, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:01:04.368997 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.347666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57166 (local address 127.10.191.190:39529)
0807 07:01:04.348244 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.348250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.349264 (+ 1014us) server_negotiation.cc:407] Connection header received
0807 07:01:04.352115 (+ 2851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.352120 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.352194 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.352291 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.354296 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.355453 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.356953 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.357763 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.357922 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.361725 (+ 3803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.361737 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.361745 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.361817 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.365739 (+ 3922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.366440 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.366448 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.366454 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.366604 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.367014 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.367021 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.367027 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.367433 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.367587 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.368256 (+ 669us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.368512 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":274,"threads_started":1}
I20260807 07:01:04.369542 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.348252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:39529 (local address 127.0.0.1:57166)
0807 07:01:04.349046 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.349137 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:04.351830 (+ 2693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:04.352550 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:04.352561 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:04.353406 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:04.354076 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.354093 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.355621 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.355625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.356805 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.356817 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.357976 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.357980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.358202 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.358877 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:04.358899 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:04.361437 (+ 2538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:04.365871 (+ 4434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.365877 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.365888 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.366301 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.366709 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.366712 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.366714 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.366895 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.367555 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:04.367560 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:04.367868 (+ 308us) client_negotiation.cc:769] Sending connection context
0807 07:01:04.368085 (+ 217us) client_negotiation.cc:240] Negotiation successful
0807 07:01:04.368454 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":294,"threads_started":1}
I20260807 07:01:04.371393 11235 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.191.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.188@KRBTEST.COM" created.
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086064, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 07:01:04.385848 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.372266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59250)
0807 07:01:04.372499 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.372526 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:04.372643 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:04.373607 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:04.373615 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:04.374143 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:04.374349 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.374363 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.375791 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.375795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.376649 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.376661 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.377548 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.377558 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.377671 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.378322 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:04.378339 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:04.380214 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:04.383358 (+ 3144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.383363 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.383366 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.383708 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.384102 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.384107 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.384110 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.384249 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.384850 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:04.384854 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:04.385001 (+ 147us) client_negotiation.cc:769] Sending connection context
0807 07:01:04.385184 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 07:01:04.385466 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 07:01:04.385987 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.372477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59250 (local address 127.10.191.189:38993)
0807 07:01:04.373211 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.373217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.373242 (+ 25us) server_negotiation.cc:407] Connection header received
0807 07:01:04.373295 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.373300 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.373448 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.373552 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.374527 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.375648 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.376795 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.377367 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.377465 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.380412 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.380423 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.380433 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.380464 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.383203 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.383832 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.383840 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.383843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.383960 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.384354 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.384361 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.384364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.384709 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.384925 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.385336 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.385596 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":543,"thread_start_us":412,"threads_started":1}
I20260807 07:01:04.388734 11235 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } has no permanent_uuid. Determining permanent_uuid...
I20260807 07:01:04.389947 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.389436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42206)
0807 07:01:04.389618 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.389773 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 07:01:04.390180 11167 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
I20260807 07:01:04.391682 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.391341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42216)
0807 07:01:04.391492 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.391585 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 07:01:04.391902 11235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:39157: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab.
Entry for principal kudu/127.10.191.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab.
I20260807 07:01:04.416106 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.188:39157
--webserver_interface=127.10.191.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab
--principal=kudu/127.10.191.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:46661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:39529,127.10.191.189:38993,127.10.191.188:39157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 07:01:04.441246 11235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } attempt: 1
I20260807 07:01:04.442615 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.442099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42222)
0807 07:01:04.442320 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.442447 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 07:01:04.443897 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.443419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42226)
0807 07:01:04.443636 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.443742 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 07:01:04.444165 11235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:39157: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
I20260807 07:01:04.498220 11128 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } attempt: 5
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086063, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 07:01:04.512413 11235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } attempt: 2
I20260807 07:01:04.513422 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.498999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59254)
0807 07:01:04.499262 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.499289 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:04.499455 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:04.499843 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:04.499848 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:04.500354 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:04.500600 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.500613 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.501701 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.501707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.503135 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.503156 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.503864 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.503870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.504136 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.504748 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:04.504775 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:04.507746 (+ 2971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:04.510784 (+ 3038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.510789 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.510793 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.511292 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.511643 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.511647 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.511651 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.511827 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.512361 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:04.512366 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:04.512528 (+ 162us) client_negotiation.cc:769] Sending connection context
0807 07:01:04.512706 (+ 178us) client_negotiation.cc:240] Negotiation successful
0807 07:01:04.513046 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 07:01:04.513502 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.512982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42232)
0807 07:01:04.513262 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.513349 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260807 07:01:04.513633 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.499099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59254 (local address 127.10.191.189:38993)
0807 07:01:04.499288 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.499293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.499384 (+ 91us) server_negotiation.cc:407] Connection header received
0807 07:01:04.499609 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.499613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.499678 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.499762 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.500771 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.501561 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.503316 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.503712 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.503806 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.507936 (+ 4130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.507941 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.507944 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.507976 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.510635 (+ 2659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.511405 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.511409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.511411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.511531 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.511938 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.511941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.511943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.512215 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.512326 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.512896 (+ 570us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.513158 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 07:01:04.514915 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.514513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42242)
0807 07:01:04.514688 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.514767 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 07:01:04.514930 11128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } has no permanent_uuid. Determining permanent_uuid...
W20260807 07:01:04.515447 11235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:39157: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
I20260807 07:01:04.515947 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.515587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42252)
0807 07:01:04.515730 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.515804 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 07:01:04.516871 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.516541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42256)
0807 07:01:04.516689 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.516767 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 07:01:04.517161 11128 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:39157: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
I20260807 07:01:04.568372 11128 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } attempt: 1
I20260807 07:01:04.569617 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.569147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42266)
0807 07:01:04.569354 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.569443 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 07:01:04.570621 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.570282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42268)
0807 07:01:04.570442 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.570513 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 07:01:04.570835 11128 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:39157: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
I20260807 07:01:04.606698 11235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } attempt: 3
I20260807 07:01:04.608081 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.607369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42278)
0807 07:01:04.607678 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.607826 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 07:01:04.609444 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.608787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42288)
0807 07:01:04.609113 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.609259 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
W20260807 07:01:04.609680 11235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:39157: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
I20260807 07:01:04.639038 11128 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } attempt: 2
I20260807 07:01:04.640295 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.639763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42304)
0807 07:01:04.640014 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.640115 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 07:01:04.641333 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.640962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42308)
0807 07:01:04.641143 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.641219 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 07:01:04.641577 11128 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:39157: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
I20260807 07:01:04.747786 11128 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } attempt: 3
I20260807 07:01:04.748998 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.748448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42316)
0807 07:01:04.748704 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.748806 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 07:01:04.750168 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.749763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42324)
0807 07:01:04.749996 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.750067 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260807 07:01:04.750365 11128 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:39157: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
I20260807 07:01:04.752894 11235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } attempt: 4
I20260807 07:01:04.754053 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.753604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42330)
0807 07:01:04.753826 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.753907 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 07:01:04.754997 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.754655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42342)
0807 07:01:04.754814 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.754893 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 07:01:04.755198 11235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:39157: Network error: Client connection negotiation failed: client connection to 127.10.191.188:39157: connect: Connection refused (error 111)
W20260807 07:01:04.788185 11250 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 07:01:04.788589 11250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:01:04.788729 11250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:01:04.788902 11250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:01:04.797880 11250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:01:04.798007 11250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:01:04.798100 11250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:01:04.798175 11250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:01:04.798286 11250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:01:04.811260 11250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:46661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:39529,127.10.191.189:38993,127.10.191.188:39157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab
--principal=kudu/127.10.191.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.188:39157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.191.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:01:04.812500 11250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:01:04.813885 11250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:01:04.825902 11262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:04.826014 11266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:04.826015 11263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:01:04.827032 11250 server_base.cc:1034] running on GCE node
I20260807 07:01:04.827836 11250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:01:04.829351 11250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:01:04.830641 11250 hybrid_clock.cc:648] HybridClock initialized: now 1786086064830586 us; error 43 us; skew 500 ppm
I20260807 07:01:04.831008 11250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086064, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:01:04.834200 11250 init.cc:377] Logged in from keytab as kudu/127.10.191.188@KRBTEST.COM (short username kudu)
I20260807 07:01:04.835672 11250 webserver.cc:460] Webserver started at http://127.10.191.188:43147/ using document root <none> and password file <none>
I20260807 07:01:04.836445 11250 fs_manager.cc:359] Metadata directory not provided
I20260807 07:01:04.836694 11250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:01:04.837127 11250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:01:04.840150 11250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/data/instance:
uuid: "fde2207b2a174200a8af1902e40fc71c"
format_stamp: "Formatted at 2026-08-07 07:01:04 on dist-test-slave-tfpf"
server_key: "69f5e1162ecdc5dd1c80685938015839"
server_key_iv: "7deb1f79130097180e19c9dda1d0975b"
server_key_version: "encryptionkey@0"
I20260807 07:01:04.840955 11250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/wal/instance:
uuid: "fde2207b2a174200a8af1902e40fc71c"
format_stamp: "Formatted at 2026-08-07 07:01:04 on dist-test-slave-tfpf"
server_key: "69f5e1162ecdc5dd1c80685938015839"
server_key_iv: "7deb1f79130097180e19c9dda1d0975b"
server_key_version: "encryptionkey@0"
I20260807 07:01:04.846138 11250 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 07:01:04.849454 11277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:01:04.850816 11250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 07:01:04.851002 11250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/wal
uuid: "fde2207b2a174200a8af1902e40fc71c"
format_stamp: "Formatted at 2026-08-07 07:01:04 on dist-test-slave-tfpf"
server_key: "69f5e1162ecdc5dd1c80685938015839"
server_key_iv: "7deb1f79130097180e19c9dda1d0975b"
server_key_version: "encryptionkey@0"
I20260807 07:01:04.851217 11250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:01:04.876063 11250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:01:04.880040 11250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:01:04.880334 11250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:01:04.899654 11250 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.188:39157
I20260807 07:01:04.899695 11353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.188:39157 every 8 connection(s)
I20260807 07:01:04.901022 11250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
I20260807 07:01:04.904836 11354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:01:04.911116 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11250
I20260807 07:01:04.911311 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786085696003154-11006-0/minicluster-data/master-2/wal/instance
I20260807 07:01:04.911870 11006 external_mini_cluster.cc:1428] Setting key 43dfcb3c04e7eff736aa4273122b7213
I20260807 07:01:04.913090 11354 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086064, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
I20260807 07:01:04.927554 11128 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } attempt: 4
I20260807 07:01:04.936256 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.915906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57180 (local address 127.10.191.190:39529)
0807 07:01:04.917267 (+ 1361us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.917273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.917295 (+ 22us) server_negotiation.cc:407] Connection header received
0807 07:01:04.917433 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.917440 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.917558 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.917698 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.919512 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.920691 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.922841 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.923439 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.923572 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.928090 (+ 4518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.928098 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.928103 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.928156 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.932074 (+ 3918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.933246 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.933255 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.933261 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.933484 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.934067 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.934074 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.934079 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.934469 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.934689 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.935571 (+ 882us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.935809 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1236,"thread_start_us":1137,"threads_started":1}
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086063, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
I20260807 07:01:04.937775 11358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.915864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:39529 (local address 127.0.0.1:57180)
0807 07:01:04.916746 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.916807 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:04.917204 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:04.917790 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:04.917797 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:04.918700 (+ 903us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:04.919310 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.919343 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.920895 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.920899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.922664 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.922691 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.923657 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.923662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.923869 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.924747 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:04.924786 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:04.927868 (+ 3082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:04.932218 (+ 4350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.932230 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.932241 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.933029 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.933612 (+ 583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.933616 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.933620 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.933927 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.934680 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:04.934689 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:04.935107 (+ 418us) client_negotiation.cc:769] Sending connection context
0807 07:01:04.936530 (+ 1423us) client_negotiation.cc:240] Negotiation successful
0807 07:01:04.936862 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"mutex_wait_us":46,"thread_start_us":308,"threads_started":1}
I20260807 07:01:04.937815 11357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.913880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42356 (local address 127.10.191.188:39157)
0807 07:01:04.914710 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.914722 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.914765 (+ 43us) server_negotiation.cc:407] Connection header received
0807 07:01:04.917190 (+ 2425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.917216 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.917555 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.917772 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.919632 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.921265 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.923043 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.923851 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.923944 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.929149 (+ 5205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.929162 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.929178 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.929218 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.933194 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.933968 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.933973 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.933975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.934160 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.934666 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.934670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.934673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.935131 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.935466 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.935837 (+ 371us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.936465 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":614,"thread_start_us":373,"threads_started":1}
I20260807 07:01:04.940088 11354 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } has no permanent_uuid. Determining permanent_uuid...
I20260807 07:01:04.944957 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.928205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42362)
0807 07:01:04.928477 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.928494 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:04.928590 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:04.929545 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:04.929553 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:04.930099 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:04.930348 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.930363 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.931794 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.931800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.933262 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.933276 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.934185 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.934192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.934418 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.935105 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:04.935130 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:04.938050 (+ 2920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:04.942295 (+ 4245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.942300 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.942304 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.942829 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.943222 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.943227 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.943231 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.943361 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.943926 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:04.943933 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:04.944109 (+ 176us) client_negotiation.cc:769] Sending connection context
0807 07:01:04.944262 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 07:01:04.944557 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260807 07:01:04.945003 11362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.928264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42362 (local address 127.10.191.188:39157)
0807 07:01:04.929241 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.929263 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.929288 (+ 25us) server_negotiation.cc:407] Connection header received
0807 07:01:04.929328 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.929331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.929383 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.929509 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.930530 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.931645 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.933398 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.934027 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.934158 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.938314 (+ 4156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.938321 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.938325 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.938359 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.942144 (+ 3785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.942950 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.942955 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.942959 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.943089 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.943471 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.943476 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.943480 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.943766 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.943912 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.944359 (+ 447us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.944566 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":867,"thread_start_us":677,"threads_started":1}
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086064, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 07:01:04.951062 11128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376: Bootstrap starting.
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:01:04.955247 11128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376: Neither blocks nor log segments found. Creating new log.
I20260807 07:01:04.956830 11128 log.cc:824] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376: Log is configured to *not* fsync() on all Append() calls
I20260807 07:01:04.957053 11358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.940903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:38993 (local address 127.0.0.1:59260)
0807 07:01:04.941115 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.941133 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:04.941232 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:04.941956 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:04.941961 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:04.942418 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:04.942620 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.942633 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.944012 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.944017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.945410 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.945426 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.946588 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.946597 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.946800 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.947307 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:04.947323 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:04.949834 (+ 2511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:04.953891 (+ 4057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.953898 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.953904 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.954446 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.954930 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.954938 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.954957 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.955161 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.956019 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:04.956023 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:04.956187 (+ 164us) client_negotiation.cc:769] Sending connection context
0807 07:01:04.956345 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 07:01:04.956650 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 07:01:04.957718 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.941255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59260 (local address 127.10.191.189:38993)
0807 07:01:04.941470 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.941476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.941495 (+ 19us) server_negotiation.cc:407] Connection header received
0807 07:01:04.941558 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.941563 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.941646 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.941753 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.942810 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.943882 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.945578 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.946249 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.946348 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.950056 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.950062 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.950066 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.950105 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.953680 (+ 3575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.954591 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.954596 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.954600 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.954774 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.955309 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.955315 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.955321 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.955736 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.955892 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.956497 (+ 605us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.956774 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 07:01:04.959033 11354 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } has no permanent_uuid. Determining permanent_uuid...
I20260807 07:01:04.960273 11128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376: No bootstrap required, opened a new log
I20260807 07:01:04.960554 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.941848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57188 (local address 127.10.191.190:39529)
0807 07:01:04.942065 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.942072 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.942089 (+ 17us) server_negotiation.cc:407] Connection header received
0807 07:01:04.942135 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.942139 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.942226 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.942316 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.943782 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.944862 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.946656 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.947601 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.947759 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.952687 (+ 4928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.952695 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.952701 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.952741 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.956587 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.957594 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.957599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.957602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.957791 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.958270 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.958274 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.958277 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.958680 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.959066 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.960046 (+ 980us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.960269 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086064, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
I20260807 07:01:04.971333 11128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } }
I20260807 07:01:04.971728 11128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b370eb9b98f4b1ea71a83c864421376, State: Initialized, Role: FOLLOWER
I20260807 07:01:04.972257 11128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } }
Aug 07 07:01:04 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 07:01:04.975451 11358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.959774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42372)
0807 07:01:04.960231 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:04.960245 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:04.960360 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:04.961188 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:04.961193 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:04.961701 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:04.961893 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.961902 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.963179 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.963184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.963995 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:04.964005 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.964872 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.964877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:04.965061 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.965653 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:04.965674 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:04.968272 (+ 2598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:04.972390 (+ 4118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.972397 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.972401 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.972923 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.973418 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:04.973425 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:04.973429 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:04.973582 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:04.974349 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:04.974353 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:04.974505 (+ 152us) client_negotiation.cc:769] Sending connection context
0807 07:01:04.974665 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 07:01:04.974974 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354}
I20260807 07:01:04.976326 11362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.959787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42372 (local address 127.10.191.188:39157)
0807 07:01:04.959961 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.959967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.960309 (+ 342us) server_negotiation.cc:407] Connection header received
0807 07:01:04.960472 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.960476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.960572 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.960667 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.962027 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.963046 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.964148 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.964585 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.964710 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.968457 (+ 3747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.968462 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.968466 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.968501 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.972226 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.973056 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.973114 (+ 58us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.973120 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.973287 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.973711 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.973718 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.973736 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.974135 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.974298 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.975739 (+ 1441us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.975959 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 07:01:04.977559 11364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:04.977929 11364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:04.981805 11128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:01:04.982151 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:04.962661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59264 (local address 127.10.191.189:38993)
0807 07:01:04.962818 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:04.962823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:04.962839 (+ 16us) server_negotiation.cc:407] Connection header received
0807 07:01:04.962881 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:04.962886 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:04.962943 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:04.963036 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:04.964596 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.965735 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.967536 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:04.968267 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:04.968369 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:04.974409 (+ 6040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:04.974415 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:04.974420 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:04.974457 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:04.978774 (+ 4317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.979625 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.979630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.979633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.979806 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:04.980274 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:04.980279 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:04.980283 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:04.980599 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:04.980861 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:04.981474 (+ 613us) server_negotiation.cc:299] Negotiation successful
0807 07:01:04.981749 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 07:01:04.982275 11354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c: Bootstrap starting.
I20260807 07:01:04.986481 11354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c: Neither blocks nor log segments found. Creating new log.
I20260807 07:01:04.987963 11354 log.cc:824] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c: Log is configured to *not* fsync() on all Append() calls
I20260807 07:01:04.988664 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:01:04.993359 11088 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7b370eb9b98f4b1ea71a83c864421376"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57188
I20260807 07:01:04.993800 11088 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:01:04.993993 11088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [term 0 FOLLOWER]: Advancing to term 1
W20260807 07:01:04.996006 11384 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 07:01:04.996147 11384 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 07:01:04.997490 11088 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } }
I20260807 07:01:04.997732 11354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c: No bootstrap required, opened a new log
I20260807 07:01:04.999846 11088 leader_election.cc:288] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [CANDIDATE]: Term 1 election: Requested vote from peers f48fe0b385bc427b9ddb9fb7d381f3a8 (127.10.191.189:38993), fde2207b2a174200a8af1902e40fc71c (127.10.191.188:39157)
I20260807 07:01:04.997522 11023 master_runner.cc:186] Error getting master registration for 127.10.191.189:38993: OK, instance_id { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" instance_seqno: 1786086064323711 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 07:01:05.008635 11023 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 07:01:05.014532 11354 raft_consensus.cc:348] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } }
I20260807 07:01:05.014964 11354 raft_consensus.cc:729] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fde2207b2a174200a8af1902e40fc71c, State: Initialized, Role: FOLLOWER
I20260807 07:01:05.015497 11354 consensus_queue.cc:260] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } }
I20260807 07:01:05.016938 11390 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:05.018141 11354 sys_catalog.cc:564] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:01:05.018167 11318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b370eb9b98f4b1ea71a83c864421376" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "fde2207b2a174200a8af1902e40fc71c"
I20260807 07:01:05.018723 11318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:01:05.023072 11318 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b370eb9b98f4b1ea71a83c864421376 in term 1.
I20260807 07:01:05.023983 11047 leader_election.cc:302] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b370eb9b98f4b1ea71a83c864421376, fde2207b2a174200a8af1902e40fc71c; no voters:
I20260807 07:01:05.024663 11364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 07:01:05.028775 11054 tablet.cc:2369] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:01:05.033159 11390 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:05.038054 11364 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [term 1 LEADER]: Becoming Leader. State: Replica: 7b370eb9b98f4b1ea71a83c864421376, State: Running, Role: LEADER
I20260807 07:01:05.039497 11364 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } }
I20260807 07:01:05.054631 11235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } attempt: 5
Aug 07 07:01:05 dist-test-slave-tfpf krb5kdc[10994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086064, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
I20260807 07:01:05.074518 11239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.055231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:39157 (local address 127.0.0.1:42386)
0807 07:01:05.055617 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:05.055651 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:05.055753 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:05.056487 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:05.056495 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:05.057255 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:05.057517 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:05.057532 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.059287 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.059295 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:05.060732 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:05.060750 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.062051 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.062060 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:05.062334 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.063005 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:05.063037 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:05.066973 (+ 3936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:05.071323 (+ 4350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:05.071331 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:05.071337 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:05.071927 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:05.072422 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:05.072428 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:05.072432 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:05.072644 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:05.073422 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:05.073429 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:05.073621 (+ 192us) client_negotiation.cc:769] Sending connection context
0807 07:01:05.073768 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 07:01:05.074064 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252}
I20260807 07:01:05.075439 11357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.055681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42386 (local address 127.10.191.188:39157)
0807 07:01:05.055887 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.055895 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.055922 (+ 27us) server_negotiation.cc:407] Connection header received
0807 07:01:05.056018 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.056027 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.056127 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.056260 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.057744 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.059104 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.060914 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.061689 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.061831 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.067226 (+ 5395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:05.067234 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:05.067239 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:05.067279 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:05.071179 (+ 3900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:05.072089 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:05.072096 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:05.072105 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:05.072264 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:05.072793 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:05.072799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:05.072803 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:05.073202 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:05.073351 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.074898 (+ 1547us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.075115 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 07:01:05.079166 11362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.052171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42378 (local address 127.10.191.188:39157)
0807 07:01:05.052352 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.052358 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.059263 (+ 6905us) server_negotiation.cc:407] Connection header received
0807 07:01:05.059728 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.059733 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.059801 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.059868 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.062150 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.063177 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.065090 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.065750 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.065847 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.069200 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:05.069206 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:05.069212 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:05.069249 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:05.073390 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:05.076731 (+ 3341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:05.076736 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:05.076740 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:05.076885 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:05.077410 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:05.077415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:05.077418 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:05.077736 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:05.077994 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.078617 (+ 623us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.078823 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 07:01:05.082682 11360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.025499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57194 (local address 127.10.191.190:39529)
0807 07:01:05.025696 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.025702 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.039368 (+ 13666us) server_negotiation.cc:407] Connection header received
0807 07:01:05.040023 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.040031 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.040131 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.040225 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.043224 (+ 2999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.044393 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.048964 (+ 4571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.049912 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.050041 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.070937 (+ 20896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:05.070946 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:05.070953 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:05.071011 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:05.075604 (+ 4593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:05.079667 (+ 4063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:05.079673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:05.079676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:05.079830 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:05.080687 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:05.080693 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:05.080696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:05.081123 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:05.081456 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.082054 (+ 598us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.082281 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 07:01:05.085247 11235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8: Bootstrap starting.
I20260807 07:01:05.094079 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.025169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59274 (local address 127.10.191.189:38993)
0807 07:01:05.025355 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.025361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.052074 (+ 26713us) server_negotiation.cc:407] Connection header received
0807 07:01:05.054227 (+ 2153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.054237 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.054364 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.054448 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.066722 (+ 12274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.068056 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.081565 (+ 13509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.082279 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.082379 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.086639 (+ 4260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:05.086645 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:05.086650 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:05.086687 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:05.090601 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:05.091378 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:05.091384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:05.091387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:05.091560 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:05.092186 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:05.092191 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:05.092194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:05.092596 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:05.092848 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.093405 (+ 557us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.093659 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 07:01:05.096271 11397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b370eb9b98f4b1ea71a83c864421376. Latest consensus state: current_term: 1 leader_uuid: "7b370eb9b98f4b1ea71a83c864421376" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:05.096885 11397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [sys.catalog]: This master's current role is: LEADER
I20260807 07:01:05.097957 11413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:01:05.100400 11413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:01:05.100569 11235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8: Neither blocks nor log segments found. Creating new log.
I20260807 07:01:05.112360 11235 log.cc:824] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8: Log is configured to *not* fsync() on all Append() calls
I20260807 07:01:05.114516 11418 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 07:01:05.117913 11235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8: No bootstrap required, opened a new log
I20260807 07:01:05.124107 11318 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [term 1 FOLLOWER]: Refusing update from remote peer 7b370eb9b98f4b1ea71a83c864421376: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:01:05.125753 11364 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:01:05.130369 11235 raft_consensus.cc:348] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } }
I20260807 07:01:05.130887 11235 raft_consensus.cc:729] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f48fe0b385bc427b9ddb9fb7d381f3a8, State: Initialized, Role: FOLLOWER
I20260807 07:01:05.131495 11235 consensus_queue.cc:260] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } }
W20260807 07:01:05.132372 11285 tablet.cc:2369] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:01:05.135099 11235 sys_catalog.cc:564] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:01:05.123392 11250 master_runner.cc:186] Error getting master registration for 127.10.191.189:38993: OK, instance_id { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" instance_seqno: 1786086064323711 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 07:01:05.136046 11250 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 07:01:05.137187 11201 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b370eb9b98f4b1ea71a83c864421376" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8"
I20260807 07:01:05.138463 11200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:01:05.134133 11420 sys_catalog.cc:455] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:05.140949 11420 sys_catalog.cc:458] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:05.145958 11200 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [term 1 FOLLOWER]: Refusing update from remote peer 7b370eb9b98f4b1ea71a83c864421376: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:01:05.151625 11201 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b370eb9b98f4b1ea71a83c864421376 in term 1.
I20260807 07:01:05.152071 11390 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b370eb9b98f4b1ea71a83c864421376. Latest consensus state: current_term: 1 leader_uuid: "7b370eb9b98f4b1ea71a83c864421376" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:05.152354 11390 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:05.154666 11416 mvcc.cc:205] Tried to move back new op lower bound from 7315808522737778688 to 7315808522416132096. Current Snapshot: MvccSnapshot[applied={T|T < 7315808522737778688}]
I20260807 07:01:05.155776 11397 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:01:05.171857 11397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b370eb9b98f4b1ea71a83c864421376" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:05.172255 11397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [sys.catalog]: This master's current role is: LEADER
I20260807 07:01:05.176210 11413 catalog_manager.cc:1347] Generated new cluster ID: 2fc126349839453caf77df6c844e9b02
I20260807 07:01:05.176317 11413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:01:05.176736 11390 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b370eb9b98f4b1ea71a83c864421376" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:05.176973 11390 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:05.189495 11420 sys_catalog.cc:455] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b370eb9b98f4b1ea71a83c864421376. Latest consensus state: current_term: 1 leader_uuid: "7b370eb9b98f4b1ea71a83c864421376" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:05.189831 11420 sys_catalog.cc:458] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:05.203958 11364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b370eb9b98f4b1ea71a83c864421376" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:05.204349 11364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376 [sys.catalog]: This master's current role is: LEADER
I20260807 07:01:05.201874 11441 sys_catalog.cc:455] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b370eb9b98f4b1ea71a83c864421376" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b370eb9b98f4b1ea71a83c864421376" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 39529 } } peers { permanent_uuid: "f48fe0b385bc427b9ddb9fb7d381f3a8" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 38993 } } peers { permanent_uuid: "fde2207b2a174200a8af1902e40fc71c" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 39157 } } }
I20260807 07:01:05.210017 11441 sys_catalog.cc:458] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:05.210843 11413 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:01:05.217437 11413 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:01:05.236964 11452 catalog_manager.cc:1259] Loaded cluster ID: 2fc126349839453caf77df6c844e9b02
I20260807 07:01:05.237102 11452 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8: loading cluster ID for follower catalog manager: success
I20260807 07:01:05.246295 11413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b370eb9b98f4b1ea71a83c864421376: Generated new TSK 0
I20260807 07:01:05.247447 11413 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 07:01:05.247530 11452 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8: acquiring CA information for follower catalog manager: success
I20260807 07:01:05.250209 11452 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f48fe0b385bc427b9ddb9fb7d381f3a8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 07:01:05.329744 11242 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.326449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59278 (local address 127.10.191.189:38993)
0807 07:01:05.326645 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.326652 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.327238 (+ 586us) server_negotiation.cc:407] Connection header received
0807 07:01:05.327615 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.327624 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.327740 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.327836 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.329435 (+ 1599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59278: BlockingRecv error: recv got EOF from 127.0.0.1:59278 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 07:01:05.332723 11360 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.326410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57202 (local address 127.10.191.190:39529)
0807 07:01:05.326650 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.326656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.330705 (+ 4049us) server_negotiation.cc:407] Connection header received
0807 07:01:05.331037 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.331046 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.331161 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.331253 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.332410 (+ 1157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57202: BlockingRecv error: recv got EOF from 127.0.0.1:57202 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 07:01:05.336175 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.334251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42398 (local address 127.10.191.188:39157)
0807 07:01:05.334448 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.334469 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.334567 (+ 98us) server_negotiation.cc:407] Connection header received
0807 07:01:05.334744 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.334749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.334831 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.334923 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.335915 (+ 992us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42398: BlockingRecv error: recv got EOF from 127.0.0.1:42398 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 07:01:05.369338 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.361574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59294 (local address 127.10.191.189:38993)
0807 07:01:05.361774 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.361780 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.362305 (+ 525us) server_negotiation.cc:407] Connection header received
0807 07:01:05.362542 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.362550 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.362750 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.362937 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:05.363417 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.364575 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.366558 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.367237 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.367364 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.367935 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:05.368619 (+ 684us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:05.368764 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.368898 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.368995 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 07:01:05.379570 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.377045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42414 (local address 127.10.191.188:39157)
0807 07:01:05.377235 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.377241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.378045 (+ 804us) server_negotiation.cc:407] Connection header received
0807 07:01:05.378272 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.378278 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.378393 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.378531 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.379297 (+ 766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42414: BlockingRecv error: recv got EOF from 127.0.0.1:42414 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 07:01:05.396042 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.383801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59304 (local address 127.10.191.189:38993)
0807 07:01:05.383982 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.383989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.389729 (+ 5740us) server_negotiation.cc:407] Connection header received
0807 07:01:05.389926 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.389932 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.390022 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.390115 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:05.390617 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.391751 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.393783 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.394510 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.394630 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.395214 (+ 584us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:05.395362 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:05.395455 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.395639 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.395734 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 07:01:05.415184 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.403762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42424 (local address 127.10.191.188:39157)
0807 07:01:05.403945 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.403951 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.413649 (+ 9698us) server_negotiation.cc:407] Connection header received
0807 07:01:05.413829 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.413835 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.413931 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.414048 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.414942 (+ 894us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42424: BlockingRecv error: recv got EOF from 127.0.0.1:42424 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 07:01:05.432945 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.425915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59306 (local address 127.10.191.189:38993)
0807 07:01:05.426101 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.426108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.426639 (+ 531us) server_negotiation.cc:407] Connection header received
0807 07:01:05.426850 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.426856 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.426941 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.427046 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:05.427522 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.428691 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.430707 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.431439 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.431571 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.432093 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:05.432229 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:05.432323 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.432505 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.432600 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260807 07:01:05.443336 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.440594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42438 (local address 127.10.191.188:39157)
0807 07:01:05.440799 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.440806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.441703 (+ 897us) server_negotiation.cc:407] Connection header received
0807 07:01:05.441905 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.441911 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.442018 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.442126 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.443053 (+ 927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42438: BlockingRecv error: recv got EOF from 127.0.0.1:42438 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 07:01:05.462230 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.455071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59322 (local address 127.10.191.189:38993)
0807 07:01:05.455277 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.455283 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.455821 (+ 538us) server_negotiation.cc:407] Connection header received
0807 07:01:05.456071 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.456077 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.456166 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.456282 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:05.456765 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.458001 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.460072 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.460793 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.460917 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.461429 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:05.461565 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:05.461664 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.461854 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.461950 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
W20260807 07:01:05.473438 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.470871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42442 (local address 127.10.191.188:39157)
0807 07:01:05.471129 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.471134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.471692 (+ 558us) server_negotiation.cc:407] Connection header received
0807 07:01:05.471979 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.471986 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.472077 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.472149 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.473233 (+ 1084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42442: BlockingRecv error: recv got EOF from 127.0.0.1:42442 (error 108)
Metrics: {"server-negotiator.queue_time_us":140}
I20260807 07:01:05.494053 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.486789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59324 (local address 127.10.191.189:38993)
0807 07:01:05.486982 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.486989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.487494 (+ 505us) server_negotiation.cc:407] Connection header received
0807 07:01:05.487639 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.487645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.487737 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.487853 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:05.488347 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.489594 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.491602 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.492369 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.492522 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.493187 (+ 665us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:05.493349 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:05.493450 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.493655 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.493737 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 07:01:05.503072 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.501394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42454 (local address 127.10.191.188:39157)
0807 07:01:05.501600 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.501605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.501645 (+ 40us) server_negotiation.cc:407] Connection header received
0807 07:01:05.501723 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.501731 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.501825 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.501949 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.502828 (+ 879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42454: BlockingRecv error: recv got EOF from 127.0.0.1:42454 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 07:01:05.533758 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.526784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59330 (local address 127.10.191.189:38993)
0807 07:01:05.526974 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.526980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.527501 (+ 521us) server_negotiation.cc:407] Connection header received
0807 07:01:05.527817 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.527824 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.527929 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.528041 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:05.528565 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.529845 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.531679 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.532319 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.532440 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.532962 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:05.533155 (+ 193us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:05.533239 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.533399 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.533493 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 07:01:05.542541 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.540436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42460 (local address 127.10.191.188:39157)
0807 07:01:05.540609 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.540617 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.541099 (+ 482us) server_negotiation.cc:407] Connection header received
0807 07:01:05.541235 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.541240 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.541326 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.541422 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.542296 (+ 874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42460: BlockingRecv error: recv got EOF from 127.0.0.1:42460 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 07:01:05.585361 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.579097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59334 (local address 127.10.191.189:38993)
0807 07:01:05.579271 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.579275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.579694 (+ 419us) server_negotiation.cc:407] Connection header received
0807 07:01:05.579932 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.579940 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.580048 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.580132 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:05.580639 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.581462 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.583498 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.583946 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.584040 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.584576 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:05.584676 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:05.584738 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.584917 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.584983 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 07:01:05.593869 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.591807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42462 (local address 127.10.191.188:39157)
0807 07:01:05.592047 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.592054 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.592315 (+ 261us) server_negotiation.cc:407] Connection header received
0807 07:01:05.592505 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.592509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.592592 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.592675 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.593635 (+ 960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42462: BlockingRecv error: recv got EOF from 127.0.0.1:42462 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 07:01:05.668378 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.662350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59340 (local address 127.10.191.189:38993)
0807 07:01:05.662565 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.662571 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.663170 (+ 599us) server_negotiation.cc:407] Connection header received
0807 07:01:05.663378 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.663382 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.663448 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.663531 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:05.664039 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.664769 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.666623 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.667073 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.667172 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.667674 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:05.667789 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:05.667850 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.668023 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.668089 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 07:01:05.676186 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.674295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42478 (local address 127.10.191.188:39157)
0807 07:01:05.674486 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.674492 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.674731 (+ 239us) server_negotiation.cc:407] Connection header received
0807 07:01:05.674909 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.674912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.674980 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.675054 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.675922 (+ 868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42478: BlockingRecv error: recv got EOF from 127.0.0.1:42478 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 07:01:05.813354 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:05.807930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59352 (local address 127.10.191.189:38993)
0807 07:01:05.808150 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.808158 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.808549 (+ 391us) server_negotiation.cc:407] Connection header received
0807 07:01:05.808797 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.808802 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.808874 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.808973 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:05.809456 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.810163 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.811579 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:05.812022 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:05.812153 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:05.812601 (+ 448us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:05.812714 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:05.812812 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:05.812981 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 07:01:05.813091 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 07:01:05.821254 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:05.819126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42492 (local address 127.10.191.188:39157)
0807 07:01:05.819330 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:05.819339 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:05.819716 (+ 377us) server_negotiation.cc:407] Connection header received
0807 07:01:05.819937 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:05.819941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:05.820016 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:05.820137 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:05.820975 (+ 838us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42492: BlockingRecv error: recv got EOF from 127.0.0.1:42492 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 07:01:06.085979 11242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:06.081056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59364 (local address 127.10.191.189:38993)
0807 07:01:06.081262 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:06.081267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:06.081628 (+ 361us) server_negotiation.cc:407] Connection header received
0807 07:01:06.081820 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:06.081824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:06.081896 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:06.081981 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:06.082410 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.083228 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.084510 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.084885 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.084988 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:06.085356 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:06.085448 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:06.085512 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:06.085727 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 07:01:06.085786 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 07:01:06.092989 11362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:06.091256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42506 (local address 127.10.191.188:39157)
0807 07:01:06.091471 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:06.091477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:06.091675 (+ 198us) server_negotiation.cc:407] Connection header received
0807 07:01:06.091827 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:06.091830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:06.091915 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:06.091998 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:06.092738 (+ 740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42506: BlockingRecv error: recv got EOF from 127.0.0.1:42506 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 07:01:06.119099 11418 catalog_manager.cc:1259] Loaded cluster ID: 2fc126349839453caf77df6c844e9b02
I20260807 07:01:06.119223 11418 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c: loading cluster ID for follower catalog manager: success
I20260807 07:01:06.122017 11418 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c: acquiring CA information for follower catalog manager: success
I20260807 07:01:06.123832 11418 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fde2207b2a174200a8af1902e40fc71c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 07:01:06.613533 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:06.608357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49254 (local address 127.10.191.189:38993)
0807 07:01:06.608897 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:06.608904 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:06.609139 (+ 235us) server_negotiation.cc:407] Connection header received
0807 07:01:06.609279 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:06.609283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:06.609352 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:06.609443 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:06.609848 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.610592 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.611929 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.612308 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.612399 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:06.612754 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:06.612849 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:06.612928 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:06.613056 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 07:01:06.613175 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":247,"threads_started":1}
I20260807 07:01:06.624588 11617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:06.619056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57812 (local address 127.10.191.188:39157)
0807 07:01:06.619559 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:06.619564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:06.619677 (+ 113us) server_negotiation.cc:407] Connection header received
0807 07:01:06.619839 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:06.619842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:06.620015 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:06.620131 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:06.620452 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.621203 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.622439 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.622834 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.622938 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:06.623375 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:06.624059 (+ 684us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:06.624164 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:06.624233 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 07:01:06.624290 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":227,"threads_started":1}
I20260807 07:01:06.639281 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:06.630620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49270 (local address 127.10.191.189:38993)
0807 07:01:06.630848 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:06.630857 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:06.632411 (+ 1554us) server_negotiation.cc:407] Connection header received
0807 07:01:06.632683 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:06.632691 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:06.632795 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:06.632888 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:06.634150 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.635231 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.637290 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.637937 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.638054 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:06.638516 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:06.638647 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:06.638739 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:06.638884 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 07:01:06.638959 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 07:01:06.639396 11617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:06.631467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57816 (local address 127.10.191.188:39157)
0807 07:01:06.632274 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:06.632282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:06.633268 (+ 986us) server_negotiation.cc:407] Connection header received
0807 07:01:06.633454 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:06.633459 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:06.633544 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:06.633644 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:06.634297 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.635331 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.637033 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.637541 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.637686 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:06.638223 (+ 537us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:06.638342 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:06.638440 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:06.639041 (+ 601us) server_negotiation.cc:299] Negotiation successful
0807 07:01:06.639115 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657}
I20260807 07:01:06.641264 11628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:06.630540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.10.191.190:39529)
0807 07:01:06.632789 (+ 2249us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:06.632798 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:06.632822 (+ 24us) server_negotiation.cc:407] Connection header received
0807 07:01:06.632956 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:06.632962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:06.633198 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:06.633385 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:06.635267 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.636418 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.638618 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:06.639440 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:06.639581 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:06.640134 (+ 553us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:06.640622 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:06.640732 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:06.640869 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 07:01:06.640953 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2088,"thread_start_us":1955,"threads_started":1}
I20260807 07:01:06.649667 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11023
I20260807 07:01:06.650802 11120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:01:06.760644 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11023
W20260807 07:01:06.792536 11282 connection.cc:535] server connection from 127.0.0.1:42362 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 07:01:06.793056 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11140
I20260807 07:01:06.794203 11230 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:01:06.900419 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11140
I20260807 07:01:06.931039 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11250
I20260807 07:01:06.932258 11347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:01:07.041709 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11250
2026-08-07T07:01:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5361 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 07:01:07 dist-test-slave-tfpf krb5kdc[11640](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 07:01:07 dist-test-slave-tfpf krb5kdc[11640](info): set up 2 sockets
Aug 07 07:01:07 dist-test-slave-tfpf krb5kdc[11640](info): commencing operation
krb5kdc: starting...
W20260807 07:01:08.754627 11006 mini_kdc.cc:121] Time spent starting KDC: real 1.663s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/test-user.keytab.
Aug 07 07:01:09 dist-test-slave-tfpf krb5kdc[11640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T07:01:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T07:01:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.191.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
Entry for principal kudu/127.10.191.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab.
W20260807 07:01:09.312033 11006 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.191.190: real 0.108s user 0.000s sys 0.044s
I20260807 07:01:09.313582 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36495
--webserver_interface=127.10.191.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:36495,127.10.191.189:43529,127.10.191.188:37925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 07:01:09.969120 11654 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 07:01:09.969893 11654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:01:09.970112 11654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:01:09.970350 11654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:01:09.982561 11654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:01:09.982692 11654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:01:09.982897 11654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:01:09.983144 11654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:01:09.983373 11654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:01:10.000061 11654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:36495,127.10.191.189:43529,127.10.191.188:37925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.190.keytab
--principal=kudu/127.10.191.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.190:36495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.191.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:01:10.002593 11654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:01:10.004928 11654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:01:10.025480 11662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:10.025955 11663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:10.026430 11665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:01:10.028707 11654 server_base.cc:1034] running on GCE node
I20260807 07:01:10.030099 11654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:01:10.032657 11654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:01:10.034054 11654 hybrid_clock.cc:648] HybridClock initialized: now 1786086070033918 us; error 82 us; skew 500 ppm
I20260807 07:01:10.034634 11654 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:01:10 dist-test-slave-tfpf krb5kdc[11640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:01:10.040457 11654 init.cc:377] Logged in from keytab as kudu/127.10.191.190@KRBTEST.COM (short username kudu)
I20260807 07:01:10.043063 11654 webserver.cc:460] Webserver started at http://127.10.191.190:46413/ using document root <none> and password file <none>
I20260807 07:01:10.044234 11654 fs_manager.cc:359] Metadata directory not provided
I20260807 07:01:10.044381 11654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:01:10.044833 11654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:01:10.050271 11654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/data/instance:
uuid: "f7110964e9d34692b02e82b6bfcce5d4"
format_stamp: "Formatted at 2026-08-07 07:01:10 on dist-test-slave-tfpf"
server_key: "d42924f61e985e8cdd7d62bce666fefb"
server_key_iv: "926c76aa47297ef531a5bdd83122cc63"
server_key_version: "encryptionkey@0"
I20260807 07:01:10.051738 11654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/wal/instance:
uuid: "f7110964e9d34692b02e82b6bfcce5d4"
format_stamp: "Formatted at 2026-08-07 07:01:10 on dist-test-slave-tfpf"
server_key: "d42924f61e985e8cdd7d62bce666fefb"
server_key_iv: "926c76aa47297ef531a5bdd83122cc63"
server_key_version: "encryptionkey@0"
I20260807 07:01:10.061421 11654 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.009s
I20260807 07:01:10.067860 11673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:01:10.070324 11654 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.004s
I20260807 07:01:10.070642 11654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/wal
uuid: "f7110964e9d34692b02e82b6bfcce5d4"
format_stamp: "Formatted at 2026-08-07 07:01:10 on dist-test-slave-tfpf"
server_key: "d42924f61e985e8cdd7d62bce666fefb"
server_key_iv: "926c76aa47297ef531a5bdd83122cc63"
server_key_version: "encryptionkey@0"
I20260807 07:01:10.071161 11654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:01:10.113229 11654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:01:10.121536 11654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:01:10.122071 11654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:01:10.153858 11654 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.190:36495
I20260807 07:01:10.153884 11742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.190:36495 every 8 connection(s)
I20260807 07:01:10.156363 11654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/data/info.pb
I20260807 07:01:10.163146 11743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:01:10.165603 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11654
I20260807 07:01:10.165988 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-0/wal/instance
I20260807 07:01:10.167017 11006 external_mini_cluster.cc:1428] Setting key fe030edc34b274a6f7574896cc4cd4d1
I20260807 07:01:10.182461 11743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 07:01:10 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.191.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.189@KRBTEST.COM" created.
I20260807 07:01:10.235517 11750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.189802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43868 (local address 127.10.191.190:36495)
0807 07:01:10.196823 (+ 7021us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:10.196859 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:10.197887 (+ 1028us) server_negotiation.cc:407] Connection header received
0807 07:01:10.203978 (+ 6091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:10.203995 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:10.204435 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:10.204706 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:10.207950 (+ 3244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.210009 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.214267 (+ 4258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.215239 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.215604 (+ 365us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:10.223037 (+ 7433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:10.223047 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:10.223072 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:10.223138 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:10.227629 (+ 4491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:10.228762 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:10.228769 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:10.228781 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:10.228983 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:10.229694 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:10.229699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:10.229702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:10.230678 (+ 976us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:10.231106 (+ 428us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:10.231986 (+ 880us) server_negotiation.cc:299] Negotiation successful
0807 07:01:10.232578 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":133,"server-negotiator.queue_time_us":6546,"thread_start_us":6093,"threads_started":1}
I20260807 07:01:10.236783 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.189802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36495 (local address 127.0.0.1:43868)
0807 07:01:10.197578 (+ 7776us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.197653 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:10.203322 (+ 5669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:10.204872 (+ 1550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:10.204900 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:10.206651 (+ 1751us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:10.207617 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:10.207660 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.210288 (+ 2628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.210299 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:10.214009 (+ 3710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:10.214057 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.215687 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.215708 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:10.216232 (+ 524us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:10.217547 (+ 1315us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:10.217630 (+ 83us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:10.222638 (+ 5008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:10.227817 (+ 5179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:10.227842 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:10.227857 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:10.228534 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:10.229239 (+ 705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:10.229254 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:10.229259 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:10.229494 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:10.230903 (+ 1409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:10.230915 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:10.231316 (+ 401us) client_negotiation.cc:769] Sending connection context
0807 07:01:10.231737 (+ 421us) client_negotiation.cc:240] Negotiation successful
0807 07:01:10.232849 (+ 1112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7315,"mutex_wait_us":214,"thread_start_us":6859,"threads_started":1}
I20260807 07:01:10.241482 11743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } has no permanent_uuid. Determining permanent_uuid...
I20260807 07:01:10.243355 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.242529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55250)
0807 07:01:10.242829 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.243058 (+ 229us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260807 07:01:10.243903 11675 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
I20260807 07:01:10.246877 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.246035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55254)
0807 07:01:10.246349 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.246554 (+ 205us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260807 07:01:10.247306 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:43529: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab.
Entry for principal kudu/127.10.191.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab.
W20260807 07:01:10.291473 11006 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.191.189: real 0.124s user 0.000s sys 0.054s
I20260807 07:01:10.292732 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.189:43529
--webserver_interface=127.10.191.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab
--principal=kudu/127.10.191.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:36495,127.10.191.189:43529,127.10.191.188:37925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 07:01:10.296922 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } attempt: 1
I20260807 07:01:10.298974 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.298054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55260)
0807 07:01:10.298401 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.298666 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 07:01:10.300789 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.300056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55262)
0807 07:01:10.300317 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.300492 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 07:01:10.301186 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:43529: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
I20260807 07:01:10.369557 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } attempt: 2
I20260807 07:01:10.371429 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.370647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55264)
0807 07:01:10.371065 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.371196 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 07:01:10.373248 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.372592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55274)
0807 07:01:10.372880 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.372971 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260807 07:01:10.373525 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:43529: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
I20260807 07:01:10.465014 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } attempt: 3
I20260807 07:01:10.466763 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.466053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55284)
0807 07:01:10.466403 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.466540 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260807 07:01:10.468464 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.467907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55296)
0807 07:01:10.468149 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.468255 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 07:01:10.468744 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:43529: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
I20260807 07:01:10.612027 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } attempt: 4
I20260807 07:01:10.613533 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.612796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55310)
0807 07:01:10.613173 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.613297 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
I20260807 07:01:10.614678 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.614230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55314)
0807 07:01:10.614398 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.614522 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 07:01:10.614880 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.189:43529: Network error: Client connection negotiation failed: client connection to 127.10.191.189:43529: connect: Connection refused (error 111)
W20260807 07:01:10.767899 11755 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 07:01:10.768347 11755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:01:10.768473 11755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:01:10.768641 11755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:01:10.776120 11755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:01:10.776214 11755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:01:10.776314 11755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:01:10.776419 11755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:01:10.776513 11755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:01:10.786521 11755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:36495,127.10.191.189:43529,127.10.191.188:37925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.189.keytab
--principal=kudu/127.10.191.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.189:43529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.191.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:01:10.787843 11755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:01:10.789275 11755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:01:10.800897 11761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:10.800966 11763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:10.800940 11768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:01:10.802258 11755 server_base.cc:1034] running on GCE node
I20260807 07:01:10.803025 11755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:01:10.804447 11755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:01:10.805698 11755 hybrid_clock.cc:648] HybridClock initialized: now 1786086070805631 us; error 41 us; skew 500 ppm
I20260807 07:01:10.806049 11755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 07:01:10 dist-test-slave-tfpf krb5kdc[11640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:01:10.809262 11755 init.cc:377] Logged in from keytab as kudu/127.10.191.189@KRBTEST.COM (short username kudu)
I20260807 07:01:10.810786 11755 webserver.cc:460] Webserver started at http://127.10.191.189:37981/ using document root <none> and password file <none>
I20260807 07:01:10.811518 11755 fs_manager.cc:359] Metadata directory not provided
I20260807 07:01:10.811657 11755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:01:10.812002 11755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:01:10.815027 11755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/data/instance:
uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6"
format_stamp: "Formatted at 2026-08-07 07:01:10 on dist-test-slave-tfpf"
server_key: "f92fb543a38a28906f09436308e1e660"
server_key_iv: "1e26cfb62ebdf4348a0e03c5d6c28721"
server_key_version: "encryptionkey@0"
I20260807 07:01:10.815871 11755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/wal/instance:
uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6"
format_stamp: "Formatted at 2026-08-07 07:01:10 on dist-test-slave-tfpf"
server_key: "f92fb543a38a28906f09436308e1e660"
server_key_iv: "1e26cfb62ebdf4348a0e03c5d6c28721"
server_key_version: "encryptionkey@0"
I20260807 07:01:10.820992 11755 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 07:01:10.824437 11778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:01:10.825726 11755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 07:01:10.825917 11755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/wal
uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6"
format_stamp: "Formatted at 2026-08-07 07:01:10 on dist-test-slave-tfpf"
server_key: "f92fb543a38a28906f09436308e1e660"
server_key_iv: "1e26cfb62ebdf4348a0e03c5d6c28721"
server_key_version: "encryptionkey@0"
I20260807 07:01:10.826130 11755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:01:10.840494 11755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:01:10.844347 11755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:01:10.844616 11755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:01:10.863556 11755 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.189:43529
I20260807 07:01:10.863577 11843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.189:43529 every 8 connection(s)
I20260807 07:01:10.865000 11755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/data/info.pb
I20260807 07:01:10.868790 11844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:01:10.874414 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11755
I20260807 07:01:10.874621 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-1/wal/instance
I20260807 07:01:10.875062 11006 external_mini_cluster.cc:1428] Setting key d3059f6989a002ba4523694922cbcc4a
I20260807 07:01:10.875357 11844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 07:01:10 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:01:10.898597 11846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.878084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43884 (local address 127.10.191.190:36495)
0807 07:01:10.878713 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:10.878720 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:10.879528 (+ 808us) server_negotiation.cc:407] Connection header received
0807 07:01:10.882376 (+ 2848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:10.882380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:10.882448 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:10.882538 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:10.884590 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.885396 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.887815 (+ 2419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.888220 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.888320 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:10.892802 (+ 4482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:10.892807 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:10.892810 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:10.892852 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:10.895483 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:10.896242 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:10.896249 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:10.896257 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:10.896379 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:10.896836 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:10.896841 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:10.896845 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:10.897198 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:10.897368 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:10.897992 (+ 624us) server_negotiation.cc:299] Negotiation successful
0807 07:01:10.898206 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":290,"threads_started":1}
I20260807 07:01:10.899472 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.878507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36495 (local address 127.0.0.1:43884)
0807 07:01:10.879346 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.879406 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:10.882050 (+ 2644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:10.882801 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:10.882814 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:10.883610 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:10.884373 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:10.884403 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.885560 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.885568 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:10.887565 (+ 1997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:10.887583 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.888459 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.888469 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:10.888781 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:10.889503 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:10.889544 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:10.892581 (+ 3037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:10.895634 (+ 3053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:10.895642 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:10.895655 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:10.896109 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:10.896495 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:10.896512 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:10.896516 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:10.896700 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:10.897329 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:10.897337 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:10.897651 (+ 314us) client_negotiation.cc:769] Sending connection context
0807 07:01:10.897909 (+ 258us) client_negotiation.cc:240] Negotiation successful
0807 07:01:10.898388 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":319,"threads_started":1}
I20260807 07:01:10.901135 11844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 07:01:10 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.191.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.191.188@KRBTEST.COM" created.
I20260807 07:01:10.914119 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } attempt: 5
I20260807 07:01:10.915023 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.901739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55330)
0807 07:01:10.901895 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.901913 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:10.902010 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:10.903188 (+ 1178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:10.903192 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:10.903659 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:10.903795 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:10.903804 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.905214 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.905221 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:10.906035 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:10.906065 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.906841 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.906847 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:10.907085 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:10.907631 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:10.907660 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:10.909570 (+ 1910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:10.912526 (+ 2956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:10.912532 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:10.912536 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:10.912940 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:10.913338 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:10.913342 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:10.913346 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:10.913492 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:10.914084 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:10.914088 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:10.914234 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 07:01:10.914375 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 07:01:10.914665 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":43}
I20260807 07:01:10.915921 11850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.902168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55330 (local address 127.10.191.189:43529)
0807 07:01:10.902814 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:10.902820 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:10.902843 (+ 23us) server_negotiation.cc:407] Connection header received
0807 07:01:10.902881 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:10.902886 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:10.903037 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:10.903194 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:10.903970 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.904985 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.906191 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.906699 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.906835 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:10.909806 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:10.909817 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:10.909828 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:10.909856 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:10.912393 (+ 2537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:10.913092 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:10.913100 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:10.913103 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:10.913219 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:10.913618 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:10.913624 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:10.913627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:10.913961 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:10.914165 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:10.915409 (+ 1244us) server_negotiation.cc:299] Negotiation successful
0807 07:01:10.915638 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":514,"thread_start_us":385,"threads_started":1}
I20260807 07:01:10.918334 11844 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } has no permanent_uuid. Determining permanent_uuid...
I20260807 07:01:10.919693 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.919177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41864)
0807 07:01:10.919391 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.919507 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260807 07:01:10.920010 11783 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Aug 07 07:01:10 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 07:01:10.927153 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.926685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41872)
0807 07:01:10.926890 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.927000 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 07:01:10.927479 11844 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
I20260807 07:01:10.930056 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.914736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55346)
0807 07:01:10.914963 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.914986 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:10.915096 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:10.916102 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:10.916108 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:10.916569 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:10.916814 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:10.916830 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.918731 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.918736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:10.919913 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:10.919926 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.920783 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.920789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:10.921013 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:10.921647 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:10.921665 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:10.923630 (+ 1965us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:10.927537 (+ 3907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:10.927542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:10.927545 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:10.927956 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:10.928335 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:10.928340 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:10.928343 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:10.928481 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:10.929019 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:10.929024 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:10.929202 (+ 178us) client_negotiation.cc:769] Sending connection context
0807 07:01:10.929368 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 07:01:10.929688 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 07:01:10.930119 11851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.915072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55346 (local address 127.10.191.189:43529)
0807 07:01:10.915737 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:10.915744 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:10.915769 (+ 25us) server_negotiation.cc:407] Connection header received
0807 07:01:10.915820 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:10.915827 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:10.915909 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:10.916968 (+ 1059us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:10.917290 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.918583 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.920061 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:10.920632 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:10.920764 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:10.923881 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:10.923885 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:10.923888 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:10.923915 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:10.927333 (+ 3418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:10.928098 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:10.928101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:10.928104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:10.928209 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:10.928597 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:10.928603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:10.928607 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:10.928880 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:10.929046 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:10.929510 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 07:01:10.929702 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":340,"threads_started":1}
I20260807 07:01:10.931253 11743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } has no permanent_uuid. Determining permanent_uuid...
I20260807 07:01:10.932298 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.931911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41886)
0807 07:01:10.932097 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.932175 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 07:01:10.933660 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.933184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41902)
0807 07:01:10.933402 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.933531 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
W20260807 07:01:10.934713 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.191.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab.
Entry for principal kudu/127.10.191.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab.
I20260807 07:01:10.956529 11006 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHuszJs/build/asan/bin/kudu
/tmp/dist-test-taskHuszJs/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.188:37925
--webserver_interface=127.10.191.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab
--principal=kudu/127.10.191.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.191.148:35269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.191.190:36495,127.10.191.189:43529,127.10.191.188:37925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 07:01:10.976845 11844 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 1
I20260807 07:01:10.978183 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.977623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41914)
0807 07:01:10.977854 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.978006 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 07:01:10.979206 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.978877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41926)
0807 07:01:10.979015 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.979099 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 07:01:10.979436 11844 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
I20260807 07:01:10.985958 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 1
I20260807 07:01:10.987104 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.986533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41928)
0807 07:01:10.986778 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.986895 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 07:01:10.988267 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:10.987798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41938)
0807 07:01:10.988003 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:10.988108 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 07:01:10.988523 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
I20260807 07:01:11.047636 11844 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 2
I20260807 07:01:11.048899 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.048303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41952)
0807 07:01:11.048559 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.048693 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 07:01:11.050072 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.049668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41964)
0807 07:01:11.049825 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.049913 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 07:01:11.050295 11844 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
I20260807 07:01:11.056773 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 2
I20260807 07:01:11.058005 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.057409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41980)
0807 07:01:11.057675 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.057792 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 07:01:11.059185 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.058744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:41992)
0807 07:01:11.058954 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.059042 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 07:01:11.059407 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
I20260807 07:01:11.141541 11844 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 3
I20260807 07:01:11.142949 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.142306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42002)
0807 07:01:11.142546 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.142705 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 07:01:11.144215 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.143665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42018)
0807 07:01:11.143938 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.144045 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260807 07:01:11.144469 11844 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
I20260807 07:01:11.165648 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 3
I20260807 07:01:11.166949 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.166323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42020)
0807 07:01:11.166583 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.166721 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 07:01:11.168268 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.167699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42024)
0807 07:01:11.167989 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.168098 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260807 07:01:11.168560 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
I20260807 07:01:11.287727 11844 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 4
I20260807 07:01:11.288892 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.288415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42030)
0807 07:01:11.288644 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.288741 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 07:01:11.290001 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.289664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42032)
0807 07:01:11.289793 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.289854 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 07:01:11.290232 11844 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
W20260807 07:01:11.309463 11855 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 07:01:11.309847 11855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 07:01:11.309978 11855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 07:01:11.310127 11855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 07:01:11.317335 11855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 07:01:11.317445 11855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 07:01:11.317576 11855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 07:01:11.317663 11855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 07:01:11.317938 11855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 07:01:11.327500 11855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.191.148:35269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.191.190:36495,127.10.191.189:43529,127.10.191.188:37925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/krb5kdc/kudu_127.10.191.188.keytab
--principal=kudu/127.10.191.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.191.188:37925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.191.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 05:58:21 UTC on ccycloud.quasar-rzbaah.root.comops.site
build id 4571904
ASAN enabled
I20260807 07:01:11.328784 11855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:01:11.330341 11855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 07:01:11.342494 11863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:11.342492 11864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:01:11.342801 11866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:01:11.343765 11855 server_base.cc:1034] running on GCE node
I20260807 07:01:11.344597 11855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 07:01:11.345809 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 4
I20260807 07:01:11.346310 11855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 07:01:11.347062 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.346531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42038)
0807 07:01:11.346817 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.346896 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
I20260807 07:01:11.347585 11855 hybrid_clock.cc:648] HybridClock initialized: now 1786086071347513 us; error 50 us; skew 500 ppm
I20260807 07:01:11.348057 11855 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:01:11.348266 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.347765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42040)
0807 07:01:11.347981 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.348082 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 07:01:11.348552 11743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.191.188:37925: Network error: Client connection negotiation failed: client connection to 127.10.191.188:37925: connect: Connection refused (error 111)
Aug 07 07:01:11 dist-test-slave-tfpf krb5kdc[11640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086071, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 07:01:11.351830 11855 init.cc:377] Logged in from keytab as kudu/127.10.191.188@KRBTEST.COM (short username kudu)
I20260807 07:01:11.353339 11855 webserver.cc:460] Webserver started at http://127.10.191.188:38191/ using document root <none> and password file <none>
I20260807 07:01:11.354071 11855 fs_manager.cc:359] Metadata directory not provided
I20260807 07:01:11.354174 11855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:01:11.354483 11855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:01:11.357759 11855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/data/instance:
uuid: "e81abfe9aadf42ca92eeacd8fc7086aa"
format_stamp: "Formatted at 2026-08-07 07:01:11 on dist-test-slave-tfpf"
server_key: "8085f22852f7d68138388f7cc39d9e7c"
server_key_iv: "7cc9aa12954d4a8de8b8f25ecb07b408"
server_key_version: "encryptionkey@0"
I20260807 07:01:11.358577 11855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/wal/instance:
uuid: "e81abfe9aadf42ca92eeacd8fc7086aa"
format_stamp: "Formatted at 2026-08-07 07:01:11 on dist-test-slave-tfpf"
server_key: "8085f22852f7d68138388f7cc39d9e7c"
server_key_iv: "7cc9aa12954d4a8de8b8f25ecb07b408"
server_key_version: "encryptionkey@0"
I20260807 07:01:11.364048 11855 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260807 07:01:11.367620 11878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:01:11.368903 11855 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 07:01:11.369143 11855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/data,/tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/wal
uuid: "e81abfe9aadf42ca92eeacd8fc7086aa"
format_stamp: "Formatted at 2026-08-07 07:01:11 on dist-test-slave-tfpf"
server_key: "8085f22852f7d68138388f7cc39d9e7c"
server_key_iv: "7cc9aa12954d4a8de8b8f25ecb07b408"
server_key_version: "encryptionkey@0"
I20260807 07:01:11.369374 11855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:01:11.391162 11855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 07:01:11.395677 11855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:01:11.395900 11855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:01:11.415694 11855 rpc_server.cc:307] RPC server started. Bound to: 127.10.191.188:37925
I20260807 07:01:11.415715 11954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.191.188:37925 every 8 connection(s)
I20260807 07:01:11.417212 11855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/data/info.pb
I20260807 07:01:11.420451 11006 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHuszJs/build/asan/bin/kudu as pid 11855
I20260807 07:01:11.420651 11006 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHuszJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786085696003154-11006-0/minicluster-data/master-2/wal/instance
I20260807 07:01:11.421279 11006 external_mini_cluster.cc:1428] Setting key aaafd80278ddfcab1212a556e9b7b456
I20260807 07:01:11.421295 11955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:01:11.431555 11955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 07:01:11 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
Aug 07 07:01:11 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086071, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
I20260807 07:01:11.445789 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.423149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42056 (local address 127.10.191.188:37925)
0807 07:01:11.423949 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.423959 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.423999 (+ 40us) server_negotiation.cc:407] Connection header received
0807 07:01:11.426019 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.426039 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.426410 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.426714 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.428718 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.430229 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.432192 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.432893 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.433025 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.437978 (+ 4953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.437984 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.438006 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.438037 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.441284 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.441936 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.441961 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.441969 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.442198 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.442594 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.442602 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.442606 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.443173 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.443533 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.443981 (+ 448us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.444406 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":408,"threads_started":1}
I20260807 07:01:11.450620 11961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.434487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.190:36495 (local address 127.0.0.1:43892)
0807 07:01:11.435470 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.435518 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:11.435725 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:11.436131 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:11.436140 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:11.436868 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:11.437239 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.437250 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.438280 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.438284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.439397 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.439411 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.440185 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.440192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.440371 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.440950 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:11.440972 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:11.443343 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:11.447379 (+ 4036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.447393 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.447401 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.447999 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.448483 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.448489 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.448492 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.448639 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.449446 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:11.449456 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:11.449697 (+ 241us) client_negotiation.cc:769] Sending connection context
0807 07:01:11.449931 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 07:01:11.450242 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":568,"threads_started":1}
I20260807 07:01:11.450700 11960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.434514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43892 (local address 127.10.191.190:36495)
0807 07:01:11.435120 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.435126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.435631 (+ 505us) server_negotiation.cc:407] Connection header received
0807 07:01:11.435863 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.435867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.435930 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.436011 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.437398 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.438100 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.439572 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.439977 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.440132 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.443547 (+ 3415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.443552 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.443555 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.443597 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.447235 (+ 3638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.448156 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.448164 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.448168 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.448342 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.448761 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.448766 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.448769 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.449266 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.449449 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.450035 (+ 586us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.450248 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":258,"threads_started":1}
I20260807 07:01:11.452309 11955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 07:01:11 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.190@KRBTEST.COM
Aug 07 07:01:11 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086071, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 07:01:11.465178 11962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.449174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43894 (local address 127.10.191.190:36495)
0807 07:01:11.449903 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.449912 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.449938 (+ 26us) server_negotiation.cc:407] Connection header received
0807 07:01:11.449992 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.449998 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.450072 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.450192 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.451712 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.452843 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.454123 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.454532 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.454677 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.458806 (+ 4129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.458812 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.458817 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.458871 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.462250 (+ 3379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.462906 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.462911 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.462915 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.463081 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.463461 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.463466 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.463471 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.463856 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.464049 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.464477 (+ 428us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.464719 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":337,"threads_started":1}
I20260807 07:01:11.466327 11961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.452895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.189:43529 (local address 127.0.0.1:55356)
0807 07:01:11.453588 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.453607 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:11.453727 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:11.454067 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:11.454071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:11.454439 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:11.454568 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.454576 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.455657 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.455664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.456538 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.456550 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.457305 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.457311 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.457494 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.458035 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:11.458052 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:11.460149 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:11.463766 (+ 3617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.463769 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.463772 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.464252 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.464674 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.464679 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.464682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.464874 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.465460 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:11.465466 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:11.465640 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 07:01:11.465802 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 07:01:11.466013 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584}
I20260807 07:01:11.466583 11963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.453131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55356 (local address 127.10.191.189:43529)
0807 07:01:11.453593 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.453602 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.453658 (+ 56us) server_negotiation.cc:407] Connection header received
0807 07:01:11.453869 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.453873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.453934 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.454045 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.454719 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.455526 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.456703 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.457148 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.457290 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.460358 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.460363 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.460366 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.460398 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.463643 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.464376 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.464381 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.464384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.464539 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.464989 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.464994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.464999 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.465343 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.465480 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.465929 (+ 449us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.466208 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":246,"threads_started":1}
I20260807 07:01:11.467490 11955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 07:01:11 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086071, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.188@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
Aug 07 07:01:11 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.191.189@KRBTEST.COM
I20260807 07:01:11.481532 11961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.468316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42068)
0807 07:01:11.468500 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.468521 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:11.468623 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:11.468937 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:11.468941 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:11.469467 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:11.469595 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.469603 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.470590 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.470596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.471410 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.471421 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.472282 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.472288 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.472525 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.473100 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:11.473125 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:11.475289 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:11.479063 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.479066 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.479068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.479422 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.479828 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.479832 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.479836 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.479994 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.480527 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:11.480530 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:11.480711 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 07:01:11.480900 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 07:01:11.481196 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 07:01:11.481904 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.468478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42068 (local address 127.10.191.188:37925)
0807 07:01:11.468618 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.468622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.468636 (+ 14us) server_negotiation.cc:407] Connection header received
0807 07:01:11.468734 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.468737 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.468787 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.468857 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.469731 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.470466 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.471546 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.472088 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.472266 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.475485 (+ 3219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.475495 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.475501 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.475543 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.478910 (+ 3367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.479540 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.479547 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.479551 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.479712 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.480107 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.480110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.480113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.480404 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.480550 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.481021 (+ 471us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.481503 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":96,"server-negotiator.queue_time_us":47}
I20260807 07:01:11.482854 11963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.467219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55358 (local address 127.10.191.189:43529)
0807 07:01:11.467455 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.467459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.467471 (+ 12us) server_negotiation.cc:407] Connection header received
0807 07:01:11.467506 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.467509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.467557 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.467628 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.469383 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.470110 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.471229 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.471632 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.471756 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.476388 (+ 4632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.476394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.476400 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.476440 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.479635 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.480372 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.480377 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.480380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.480525 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.480924 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.480928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.480931 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.481334 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.481605 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.482474 (+ 869us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.482633 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260807 07:01:11.487445 11955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa: Bootstrap starting.
I20260807 07:01:11.487633 11006 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 07:01:11.490785 11955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa: Neither blocks nor log segments found. Creating new log.
I20260807 07:01:11.491825 11955 log.cc:824] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa: Log is configured to *not* fsync() on all Append() calls
I20260807 07:01:11.490052 11711 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f7110964e9d34692b02e82b6bfcce5d4"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43894
I20260807 07:01:11.494652 11955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa: No bootstrap required, opened a new log
I20260807 07:01:11.501551 11955 raft_consensus.cc:348] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } }
I20260807 07:01:11.501883 11955 raft_consensus.cc:729] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e81abfe9aadf42ca92eeacd8fc7086aa, State: Initialized, Role: FOLLOWER
I20260807 07:01:11.502328 11955 consensus_queue.cc:260] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } }
I20260807 07:01:11.503239 11966 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.503641 11966 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:11.504140 11955 sys_catalog.cc:564] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [sys.catalog]: configured and running, proceeding with master startup.
W20260807 07:01:11.514190 11984 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 07:01:11.514331 11984 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 07:01:11.511885 11855 master_runner.cc:186] Error getting master registration for 127.10.191.190:36495: OK, instance_id { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" instance_seqno: 1786086070145043 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 07:01:11.523305 11855 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 07:01:11.589478 11844 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 5
Aug 07 07:01:11 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.189@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
I20260807 07:01:11.604699 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.590369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42076 (local address 127.10.191.188:37925)
0807 07:01:11.590677 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.590683 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.590707 (+ 24us) server_negotiation.cc:407] Connection header received
0807 07:01:11.590861 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.590869 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.590955 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.591073 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.591920 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.592734 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.594022 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.594494 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.594631 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.598272 (+ 3641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.598277 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.598280 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.598313 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.601980 (+ 3667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.602631 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.602637 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.602641 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.602779 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.603210 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.603215 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.603219 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.603525 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.603719 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.604127 (+ 408us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.604351 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260807 07:01:11.604700 11847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.590308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42076)
0807 07:01:11.590549 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.590573 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:11.590716 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:11.591131 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:11.591136 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:11.591575 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:11.591751 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.591761 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.592898 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.592905 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.593863 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.593876 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.594664 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.594680 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.594933 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.595605 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:11.595624 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:11.598058 (+ 2434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:11.602111 (+ 4053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.602116 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.602120 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.602500 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.602900 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.602905 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.602909 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.603080 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.603654 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:11.603659 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:11.603845 (+ 186us) client_negotiation.cc:769] Sending connection context
0807 07:01:11.604012 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 07:01:11.604301 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 07:01:11.610857 11844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6: Bootstrap starting.
I20260807 07:01:11.615072 11844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6: Neither blocks nor log segments found. Creating new log.
I20260807 07:01:11.616109 11844 log.cc:824] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6: Log is configured to *not* fsync() on all Append() calls
I20260807 07:01:11.618780 11844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6: No bootstrap required, opened a new log
I20260807 07:01:11.625773 11743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } attempt: 5
I20260807 07:01:11.629339 11844 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } }
I20260807 07:01:11.629654 11844 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ffdf3c33244a2cbf0ff6f8c90770b6, State: Initialized, Role: FOLLOWER
I20260807 07:01:11.630275 11844 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } }
I20260807 07:01:11.632052 11990 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.632495 11990 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:11.633651 11844 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [sys.catalog]: configured and running, proceeding with master startup.
Aug 07 07:01:11 dist-test-slave-tfpf krb5kdc[11640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786086070, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.191.190@KRBTEST.COM for kudu/127.10.191.188@KRBTEST.COM
I20260807 07:01:11.644467 11749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.626458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.191.188:37925 (local address 127.0.0.1:42078)
0807 07:01:11.626737 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 07:01:11.626756 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 07:01:11.626877 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 07:01:11.627447 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 07:01:11.627454 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 07:01:11.627961 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0807 07:01:11.628165 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.628190 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.629715 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.629721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.631346 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 07:01:11.631369 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.632720 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.632727 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 07:01:11.632929 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.633775 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 07:01:11.633800 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 07:01:11.636830 (+ 3030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 07:01:11.641355 (+ 4525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.641360 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.641365 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.641968 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.642475 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 07:01:11.642480 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 07:01:11.642484 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 07:01:11.642668 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 07:01:11.643371 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 07:01:11.643377 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 07:01:11.643662 (+ 285us) client_negotiation.cc:769] Sending connection context
0807 07:01:11.643794 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 07:01:11.644065 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162}
I20260807 07:01:11.645732 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.626530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42078 (local address 127.10.191.188:37925)
0807 07:01:11.626715 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.626721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.626827 (+ 106us) server_negotiation.cc:407] Connection header received
0807 07:01:11.627042 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.627048 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.627125 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.627226 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.628337 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.629536 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.631533 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.632316 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.632447 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.637193 (+ 4746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.637200 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.637205 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.637246 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.641186 (+ 3940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.642150 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.642155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.642159 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.642331 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.642801 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.642807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.642810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.643205 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.645044 (+ 1839us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.645180 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.645388 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 07:01:11.648167 11887 tablet.cc:2369] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:01:11.652268 11743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4: Bootstrap starting.
I20260807 07:01:11.657640 11743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4: Neither blocks nor log segments found. Creating new log.
I20260807 07:01:11.659346 11743 log.cc:824] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4: Log is configured to *not* fsync() on all Append() calls
I20260807 07:01:11.663625 11743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4: No bootstrap required, opened a new log
I20260807 07:01:11.675999 11743 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } }
I20260807 07:01:11.676436 11743 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7110964e9d34692b02e82b6bfcce5d4, State: Initialized, Role: FOLLOWER
I20260807 07:01:11.677001 11743 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } }
W20260807 07:01:11.680305 12008 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 07:01:11.680434 12008 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 07:01:11.681893 12010 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.682296 12010 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:11.684013 11743 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:01:11.684099 11711 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:01:11.684303 11711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:01:11.675019 11755 master_runner.cc:186] Error getting master registration for 127.10.191.190:36495: OK, instance_id { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" instance_seqno: 1786086070145043 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 07:01:11.686666 11755 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 07:01:11.687741 11711 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } }
I20260807 07:01:11.690127 11923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f7110964e9d34692b02e82b6bfcce5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa"
I20260807 07:01:11.690169 11816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f7110964e9d34692b02e82b6bfcce5d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6"
I20260807 07:01:11.690644 11923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:01:11.690672 11816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:01:11.694417 11923 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7110964e9d34692b02e82b6bfcce5d4 in term 1.
I20260807 07:01:11.694974 11816 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7110964e9d34692b02e82b6bfcce5d4 in term 1.
I20260807 07:01:11.695130 11677 leader_election.cc:302] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e81abfe9aadf42ca92eeacd8fc7086aa, f7110964e9d34692b02e82b6bfcce5d4; no voters:
I20260807 07:01:11.695569 12010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:01:11.695758 11711 leader_election.cc:288] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [CANDIDATE]: Term 1 election: Requested vote from peers f4ffdf3c33244a2cbf0ff6f8c90770b6 (127.10.191.189:43529), e81abfe9aadf42ca92eeacd8fc7086aa (127.10.191.188:37925)
I20260807 07:01:11.696319 12010 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [term 1 LEADER]: Becoming Leader. State: Replica: f7110964e9d34692b02e82b6bfcce5d4, State: Running, Role: LEADER
I20260807 07:01:11.696902 12010 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } }
I20260807 07:01:11.710633 12013 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7110964e9d34692b02e82b6bfcce5d4. Latest consensus state: current_term: 1 leader_uuid: "f7110964e9d34692b02e82b6bfcce5d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.711216 12013 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [sys.catalog]: This master's current role is: LEADER
I20260807 07:01:11.722276 12017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 07:01:11.738893 12017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 07:01:11.788766 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.717477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42082 (local address 127.10.191.188:37925)
0807 07:01:11.717684 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.717690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.729355 (+ 11665us) server_negotiation.cc:407] Connection header received
0807 07:01:11.729605 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.729611 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.729711 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.729783 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.747309 (+ 17526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.748460 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.754294 (+ 5834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.755049 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.755150 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.773254 (+ 18104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.773262 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.773267 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.773313 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.777291 (+ 3978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.783891 (+ 6600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.783897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.783901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.784050 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.784485 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.784491 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.784494 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.784904 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.785183 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.788092 (+ 2909us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.788358 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 07:01:11.790417 11962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.716390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43902 (local address 127.10.191.190:36495)
0807 07:01:11.716613 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.716619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.725844 (+ 9225us) server_negotiation.cc:407] Connection header received
0807 07:01:11.726180 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.726198 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.726278 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.726355 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.745216 (+ 18861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.746355 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.753204 (+ 6849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.753932 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.754036 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.778752 (+ 24716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.778759 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.778764 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.778809 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.782611 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.786512 (+ 3901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.786531 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.786534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.786668 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.787049 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.787054 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.787057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.787393 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.787613 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.789869 (+ 2256us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.790093 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 07:01:11.806996 11963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:11.733851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55360 (local address 127.10.191.189:43529)
0807 07:01:11.734068 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:11.734077 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:11.734670 (+ 593us) server_negotiation.cc:407] Connection header received
0807 07:01:11.739131 (+ 4461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:11.739137 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:11.739220 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:11.739290 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:11.751455 (+ 12165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.752529 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.770526 (+ 17997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:11.771180 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:11.771283 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:11.793319 (+ 22036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 07:01:11.793327 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 07:01:11.793331 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 07:01:11.793390 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 07:01:11.797744 (+ 4354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.803978 (+ 6234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.803984 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.804005 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.804208 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 07:01:11.804757 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 07:01:11.804763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 07:01:11.804766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 07:01:11.805281 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 07:01:11.805557 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:11.806259 (+ 702us) server_negotiation.cc:299] Negotiation successful
0807 07:01:11.806540 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 07:01:11.823887 11923 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [term 1 FOLLOWER]: Refusing update from remote peer f7110964e9d34692b02e82b6bfcce5d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:01:11.827310 11816 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [term 1 FOLLOWER]: Refusing update from remote peer f7110964e9d34692b02e82b6bfcce5d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:01:11.829478 12013 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:01:11.831619 12013 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 07:01:11.847115 11787 tablet.cc:2369] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:01:11.863996 12045 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 07:01:11.866197 11966 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7110964e9d34692b02e82b6bfcce5d4. Latest consensus state: current_term: 1 leader_uuid: "f7110964e9d34692b02e82b6bfcce5d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.866523 11966 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:11.870957 12037 mvcc.cc:205] Tried to move back new op lower bound from 7315808550146052096 to 7315808549676044288. Current Snapshot: MvccSnapshot[applied={T|T < 7315808550146052096}]
I20260807 07:01:11.873342 12038 mvcc.cc:205] Tried to move back new op lower bound from 7315808550146052096 to 7315808549676044288. Current Snapshot: MvccSnapshot[applied={T|T < 7315808550146052096}]
I20260807 07:01:11.877681 11966 sys_catalog.cc:455] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7110964e9d34692b02e82b6bfcce5d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.877995 11966 sys_catalog.cc:458] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:11.881291 12017 catalog_manager.cc:1347] Generated new cluster ID: 4032d423ab92492a82d21ab92cf029bf
I20260807 07:01:11.881395 12017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 07:01:11.888127 12013 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f7110964e9d34692b02e82b6bfcce5d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.888404 12013 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [sys.catalog]: This master's current role is: LEADER
I20260807 07:01:11.896072 11990 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7110964e9d34692b02e82b6bfcce5d4. Latest consensus state: current_term: 1 leader_uuid: "f7110964e9d34692b02e82b6bfcce5d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.896425 11990 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:11.897920 12010 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f7110964e9d34692b02e82b6bfcce5d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.898233 12010 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4 [sys.catalog]: This master's current role is: LEADER
I20260807 07:01:11.904682 11990 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f7110964e9d34692b02e82b6bfcce5d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7110964e9d34692b02e82b6bfcce5d4" member_type: VOTER last_known_addr { host: "127.10.191.190" port: 36495 } } peers { permanent_uuid: "f4ffdf3c33244a2cbf0ff6f8c90770b6" member_type: VOTER last_known_addr { host: "127.10.191.189" port: 43529 } } peers { permanent_uuid: "e81abfe9aadf42ca92eeacd8fc7086aa" member_type: VOTER last_known_addr { host: "127.10.191.188" port: 37925 } } }
I20260807 07:01:11.904915 11990 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 07:01:11.915690 12017 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 07:01:11.917662 12017 catalog_manager.cc:1504] Loading token signing keys...
I20260807 07:01:11.971104 12017 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7110964e9d34692b02e82b6bfcce5d4: Generated new TSK 0
I20260807 07:01:11.972374 12017 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 07:01:12.088075 11962 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.080610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43916 (local address 127.10.191.190:36495)
0807 07:01:12.080921 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.080927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.080948 (+ 21us) server_negotiation.cc:407] Connection header received
0807 07:01:12.081029 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.081035 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.081153 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.081257 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.087787 (+ 6530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43916: BlockingRecv error: recv got EOF from 127.0.0.1:43916 (error 108)
Metrics: {"server-negotiator.queue_time_us":180}
W20260807 07:01:12.091332 11958 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.080938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42098 (local address 127.10.191.188:37925)
0807 07:01:12.081250 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.081256 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.089233 (+ 7977us) server_negotiation.cc:407] Connection header received
0807 07:01:12.089971 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.089977 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.090059 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.090130 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.091116 (+ 986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42098: BlockingRecv error: recv got EOF from 127.0.0.1:42098 (error 108)
Metrics: {"server-negotiator.queue_time_us":187}
W20260807 07:01:12.094542 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.081784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55366 (local address 127.10.191.189:43529)
0807 07:01:12.081994 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.081999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.092529 (+ 10530us) server_negotiation.cc:407] Connection header received
0807 07:01:12.093203 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.093209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.093295 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.093375 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.094308 (+ 933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55366: BlockingRecv error: recv got EOF from 127.0.0.1:55366 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 07:01:12.104121 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.101947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55382 (local address 127.10.191.189:43529)
0807 07:01:12.102100 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.102117 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.102624 (+ 507us) server_negotiation.cc:407] Connection header received
0807 07:01:12.102832 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.102839 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.102961 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.103076 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.103871 (+ 795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55382: BlockingRecv error: recv got EOF from 127.0.0.1:55382 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 07:01:12.117043 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.114952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55394 (local address 127.10.191.189:43529)
0807 07:01:12.115105 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.115111 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.115629 (+ 518us) server_negotiation.cc:407] Connection header received
0807 07:01:12.115797 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.115802 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.115897 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.116003 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.116829 (+ 826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55394: BlockingRecv error: recv got EOF from 127.0.0.1:55394 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 07:01:12.124223 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.122206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55410 (local address 127.10.191.189:43529)
0807 07:01:12.122363 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.122369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.122845 (+ 476us) server_negotiation.cc:407] Connection header received
0807 07:01:12.123014 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.123018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.123101 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.123210 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.123972 (+ 762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55410: BlockingRecv error: recv got EOF from 127.0.0.1:55410 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 07:01:12.135126 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.131320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55414 (local address 127.10.191.189:43529)
0807 07:01:12.131517 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.131522 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.133716 (+ 2194us) server_negotiation.cc:407] Connection header received
0807 07:01:12.133921 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.133926 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.134014 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.134148 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.134931 (+ 783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55414: BlockingRecv error: recv got EOF from 127.0.0.1:55414 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 07:01:12.152042 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.149424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55416 (local address 127.10.191.189:43529)
0807 07:01:12.149644 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.149651 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.150453 (+ 802us) server_negotiation.cc:407] Connection header received
0807 07:01:12.150664 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.150669 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.150783 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.150922 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.151736 (+ 814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55416: BlockingRecv error: recv got EOF from 127.0.0.1:55416 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260807 07:01:12.185266 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.182949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55424 (local address 127.10.191.189:43529)
0807 07:01:12.183158 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.183165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.183733 (+ 568us) server_negotiation.cc:407] Connection header received
0807 07:01:12.183950 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.183956 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.184043 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.184143 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.185022 (+ 879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55424: BlockingRecv error: recv got EOF from 127.0.0.1:55424 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 07:01:12.225812 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.223218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55426 (local address 127.10.191.189:43529)
0807 07:01:12.223433 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.223441 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.223950 (+ 509us) server_negotiation.cc:407] Connection header received
0807 07:01:12.224212 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.224224 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.224323 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.224446 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.225532 (+ 1086us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55426: BlockingRecv error: recv got EOF from 127.0.0.1:55426 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 07:01:12.302081 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.299593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55428 (local address 127.10.191.189:43529)
0807 07:01:12.299807 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.299813 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.300434 (+ 621us) server_negotiation.cc:407] Connection header received
0807 07:01:12.300684 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.300688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.300768 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.300853 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.301821 (+ 968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55428: BlockingRecv error: recv got EOF from 127.0.0.1:55428 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 07:01:12.435597 11963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 07:01:12.433717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55442 (local address 127.10.191.189:43529)
0807 07:01:12.433895 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.433899 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.434291 (+ 392us) server_negotiation.cc:407] Connection header received
0807 07:01:12.434516 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.434520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.434594 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.434685 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 07:01:12.435412 (+ 727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55442: BlockingRecv error: recv got EOF from 127.0.0.1:55442 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 07:01:12.516327 11984 catalog_manager.cc:1259] Loaded cluster ID: 4032d423ab92492a82d21ab92cf029bf
I20260807 07:01:12.516431 11984 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa: loading cluster ID for follower catalog manager: success
I20260807 07:01:12.518978 11984 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa: acquiring CA information for follower catalog manager: success
I20260807 07:01:12.520725 11984 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e81abfe9aadf42ca92eeacd8fc7086aa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 07:01:12.682586 12008 catalog_manager.cc:1259] Loaded cluster ID: 4032d423ab92492a82d21ab92cf029bf
I20260807 07:01:12.682735 12008 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6: loading cluster ID for follower catalog manager: success
I20260807 07:01:12.685245 12008 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6: acquiring CA information for follower catalog manager: success
I20260807 07:01:12.687022 12008 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f4ffdf3c33244a2cbf0ff6f8c90770b6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 07:01:12.700315 11963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:12.695299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55458 (local address 127.10.191.189:43529)
0807 07:01:12.695492 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.695498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.695712 (+ 214us) server_negotiation.cc:407] Connection header received
0807 07:01:12.695874 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.695878 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.695997 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.696091 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:12.696521 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.697306 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.698518 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.698872 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.698956 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:12.699339 (+ 383us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:12.699792 (+ 453us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:12.699893 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:12.699998 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 07:01:12.700054 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 07:01:12.710994 12159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:12.705818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42104 (local address 127.10.191.188:37925)
0807 07:01:12.706335 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.706340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.706418 (+ 78us) server_negotiation.cc:407] Connection header received
0807 07:01:12.706629 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.706633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.706763 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.706885 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:12.707236 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.707885 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.709032 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.709447 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.709535 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:12.709968 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:12.710402 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:12.710523 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:12.710598 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 07:01:12.710659 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":294,"threads_started":1}
I20260807 07:01:12.724970 12159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:12.717120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42116 (local address 127.10.191.188:37925)
0807 07:01:12.717282 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.717289 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.718653 (+ 1364us) server_negotiation.cc:407] Connection header received
0807 07:01:12.718951 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.718958 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.719047 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.719109 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:12.719852 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.720822 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.723062 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.723488 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.723638 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:12.724135 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:12.724278 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:12.724378 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:12.724590 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 07:01:12.724668 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 07:01:12.725440 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:12.716708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43924 (local address 127.10.191.190:36495)
0807 07:01:12.717989 (+ 1281us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.717997 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.718038 (+ 41us) server_negotiation.cc:407] Connection header received
0807 07:01:12.718189 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.718198 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.718443 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.718651 (+ 208us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:12.719310 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.720476 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.722826 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.723475 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.723602 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:12.724137 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:12.724537 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:12.724992 (+ 455us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:12.725036 (+ 44us) server_negotiation.cc:299] Negotiation successful
0807 07:01:12.725184 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1082,"thread_start_us":1257,"threads_started":1}
I20260807 07:01:12.725507 11963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 07:01:12.717708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55474 (local address 127.10.191.189:43529)
0807 07:01:12.717959 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 07:01:12.717966 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 07:01:12.719408 (+ 1442us) server_negotiation.cc:407] Connection header received
0807 07:01:12.719627 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 07:01:12.719631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 07:01:12.719694 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 07:01:12.719790 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 07:01:12.720287 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.720972 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.722746 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 07:01:12.723463 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 07:01:12.723596 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 07:01:12.724516 (+ 920us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 07:01:12.724656 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 07:01:12.724752 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 07:01:12.725130 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 07:01:12.725221 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 07:01:12.730837 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11654
I20260807 07:01:12.732016 11738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:01:12.840372 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11654
I20260807 07:01:12.874715 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11755
I20260807 07:01:12.876240 11839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:01:12.989228 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11755
I20260807 07:01:13.019241 11006 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskHuszJs/build/asan/bin/kudu pid 11855
I20260807 07:01:13.020388 11949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 07:01:13.124778 11006 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHuszJs/build/asan/bin/kudu with pid 11855
2026-08-07T07:01:13Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (6084 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (11445 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (377094 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST